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ABSTRACT 


This  thesis  investigates  the  problem  of  automatic 
transcription  of  the  morse  signal,  and  describes  and 
documents  several  approaches  to  filtering,  processing,  and 
decoding  it  for  transcription.  The  baseband  signal  is  first 
modeled  as  a modified  random  telegraph  wave.  A discrete 
Kalman  filter  and  a linear  smoother  are  then  used  to  process 
the  demodulated  signal  in  order  to  gain  a measure  of  the 
effectiveness  and  applicability  of  this  model.  It  is  shown 
experimentally  that  this  model  and  processing  yield  a 
significant  reduction  in  the  transcription  error  rate.  Next, 
a Viterbi  decoder  algorithm  based  on  a simple  Markov  model 
of  the  code  is  programmed  and  tested.  Finally,  the  base- 
band signal  model  is  incorporated  in  a more  general  model 
for  pre-detection  Kalman  filtering.  It  is  shown  that  this 
filter  permits  acceptable  recovery  of  morse  signals  whose 
average  signal-to-noise  ratio  is  as  low  as  -14  d3  in  a 2 kHz 


bandwidth. 
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I.  INTRODUCTION 


Economic  inflation  and  the  national  commitment  to  the 
all-volunteer  Armed  Forces  concept  have  combined  to  produce 
unprecedented  increases  in  costs  of  both  manpower  and  weapon 
systems  in  recent  years.  The  public's  keen  awareness  of 
these  higher  costs,  together  with  less  than  enthusiastic 
support  of  defense  programs  in  general,  has  caused  Congress 
to  be  reluctant  to  authorize  increases  in  defense  expenditures. 
Thus  it  has  become  necessary  to  reduce  the  number  of  armed 
forces  personnel  in  order  to  keep  defense  expenditures  within 
authorized  limits.  This  reduction  has  had  the  effect  of 
intensifying  the  development  of  mechanization  of  appropriate 
manual  tasks  on  a broad  front. 

Signal  surveillance  conducted  by  the  armed  forces, 
recognized  as  an  essential  and  integral  part  of  intelligent 
tactical  and  strategic  planning,  is  one  such  area  where 
automation  is  receiving  increased  attention  and  support.  In 
particular,  the  human  operator  has  long  been  relied  upon  to 
provide  the  necessary  manual  transcription  of  manual  morse 
circuits  under  surveillance.  Because  of  the  reduced  manpower 
levels,  this  surveillance  and  transcription  must  be  tranferred 
to  mechanized  equipment  if  this  source  of  intelligence  is  to 
remain  timely  and  effective. 

This  thesis  investigates  the  problem  of  automatic  trans- 
cription of  the  morse  signal,  and  describes  and  documents 
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several  approaches  to  filtering,  processing,  and  decoding 
it  for  transcription.  The  baseband  morse  signal  process  is 
first  modeled  as  a modified., random  telegraph  wave.  A discrete 
Kalman  filter  and  a linear  smoother  are  then  used  to  process 
the  demodulated  signal  in  order  to  gain  a measure  of  the 
effectiveness  and  applicability  of  this  model.  It  is  shown 
experimentally  that  this  model  and  processing  yield  a 
significant  reduction  in  the  transcription  error  rate.  Next, 
a Viterbi  decoder  algorithm  based  on  a simple  Markov  model 
of  the  code  is  programmed  and  tested.  Finally,  a more  general 
model  of  the  signal  process,  incorporating  the  baseband  model, 
is  used  to  design  and  implement  a pre-detection  Kalman  filter. 
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II.  PROBLEM  DESCRIPTION 


A.  THE  MANUAL  MORSE  SIGNAL  PROCESS 

It  is  assumed  that  the  reader  is  familiar  with  the 
manual  morse  signal,  its  pecularities , vagaries,  and 
uncertainties,  and  with  current  methods  of  transcription. 

To  formalize  the  discussion,  however,  certain  definitions 
of  the  terms  used  and  a brief  description  of  the  signal  are 
in  order. 

As  used  throughout  this  report,  the  term  morse  signal 
refers  to  international  Morse  Code,  sent  manually  by  key, 
manual  "bug",  or  electronic  keyer.  The  problem  of  tran- 
scribing keyboard  morse,  that  which  is  sent  automatically 
with  standard  parameters,  will  not  be  considered,  although 
certain  results  are  applicable.  The  baseband  morse  signal 
is  the  output  of  the  keyer  and  is  represented  by  the  logic 
levels  "0"  and  "1",-  corresponding  to  the  states  "key  up" 
and  "key  down."  The  five  characters  of  the  international 
morse  code  are  identified  as:  dot,  dash,  element-space , 

letter-space,  and  word-space . The  term  element^  refers  to 
the  standard  time  unit  of  the  code;  its  actual  duration  in 
seconds  will  of  course  vary  with  sending  speed.  Standard 
morse  code  consists  of  the  character  lengths  shown  in 
Table  I. 


Sometimes  the  terms 


baud  and  bit  are  used. 
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TABLE  I 

STANDARD  MORSE  CHARACTERS 


Character  Symbol 

Dot 

Dash 

Element-space  * 

Letter-space 

Word-space  w 


Duration  (in  elements) 
1 
3 
1 
3 
7 


The  standard  word  (including  word-space)  in  morse 
communication  is  50  elements  in  length.  Thus  the  element 
duration  in  seconds  for  a given  sending  speed  may  be 
calculated  as  6/5  times  the  reciprocal  of  the  speed  in  words 
per  minute.  The  author  is  unaware  of  any  generally  accepted 
standard  for  the  bandwidth  of  the  baseband  morse  signal;  it 
was  found  to  be  convenient  to  express  the  upper  limit  of  the 
bandwidth  as  three  times  the  reciprocal  of  the  element 
duration.  Thus  a code  speed  of  36  wpm  has  a bandwidth  of 
90  Hz. 

An  actual  (as  opposed  to  standard)  morse  signal,  as 
those  familiar  with  the  problem  are  aware,  may  exhibit 
quite  a wide  variation  from  standard  code  in  character 
duration,  speed  variability,  and  consistency  of  element 
duration.  Since  these  variations  are  often  unique  to  the 
particular  sending  operator,  and  in  many  cases  may  depend 
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on  the  type  of  traffic  being  sent  as  well,  it  is  difficult, 
if  not  impossible,  to  describe  a "typical"  morse  signal. 

This  variability  is  illustrated  in  Figures  1 and  2,  which 
are  histograms  of  the  character  duration  of  two  different 
amateur  ratio  operators  recorded  on  the  air.  As  can  be  seen, 
the  distributions  are  different,  with  the  least  variability 
in  both  cases  appearing  in  the  dot  and  element-space 
durations . 

B . SYSTEM  CONSTRAINTS 

The  signal  processor  will  obviously  play  an  important 
role  in  the  automated  manual  morse  intercept  and  transcription 
system.  In  order  to  fully  appreciate  the  system  constraints 
under  which  the  processor  was  developed,  and  the  context  in 
which  it  is  expected  to  operate,  an  outline  of  the  integrated 
system  is  presented.  Referring  to  the  system  block  diagram. 
Figure  3,  its  three  basic  components  may  be  briefly  described 
as  follows. 

1.  Modulation  Sorting  Subsystem 

This  subsystem  scans  the  band  and/or  frequencies  of 
interest  and  detects  the  presence  of  morse  signals  in  a 
(typically)  2 kHz  band.  Upon  detection  of  a morse  signal,  a 
separate  digitally-tuned  receiver  is  automatically  tuned  to 
the  signal  frequency  for  reception. 

2 . Morse  Processor 

This  signal  processor  is  currently  the  only  part 
of  the  system  which  is  not  in  existing  hardware  or  software. 
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Its  basic  function  is  to  minimize  error  probability  in  the 
face  cf  noise,  interference,  and  uncertain  signal  parameters. 

3 . Automatic  Transcriber  ■ 

This  component  translates  the  code  into  letters  of 
the  alphabet;  there  are  currently  several  transcribers 
available  which  have  proven  effective  at  adequate  signal- 
to-noise  ratios  with  modest  signal  parameter  variation  [1],[2]. 
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gure 


Number  of 
Marks 


* qure  2 . Character 


III.  DESIGN  OBJECTIVES 


The  ultimate  goal  of  the  intercept  and  transcription 
system  is  to  provide  output  copy  with  an  error  rate  no 
greater  than  that  which  a "good"  human  operator  can  provide. 
Such  an  operator  manually  transcribing  the  morse  signal  can 
adapt  rapidly  to  changing  signal  parameters  and  has  little 
trouble  distinguishing  dots  from  dashes  even  if  the  sender's 
keying  is  far  from  perfect.  Additionally,  he  can  adapt 
readily  to  the  noise  and  interference  environment  and  reliably 
copy  a signal  in  the  presence  of  numerous  other  morse  and 
non-morse  signals. 

Specific  operator  performance  data  were  not  available  to 
the  author,  thus  only  broad  design  objectives  were  formulated 
based  on  a limited  number  of  both  subjective  and  experimental 
data  obtained  using  amateur  radio  operators  as  subjects. 

Random  letter  sequences  were  sent  using  the  Pickering  model 
KB-1  morse  keyboard  to  key  a signal  generator  at  an  audio 
frequency  selected  by  the  subject.  Noise  was  added  to  the 
audio  signal  and  the  SNR  in  each  bandwidth  used  was  recorded. 
The  results,  summarized  in  Table  II,  tabulate  error  rate 
versus  SNR  in  the  bandwidth  used.  Also  shown  is  the  SNR  in 
the  signal  bandwidth  as  previously  defined  in  Section  II. A. 

The  conclusions  drawn  from  these  data  is  that  a good 
operator  can  cop/  reasonably  well  down  to  -13  dB  SNR  in  a 
2 kHz  bandwidth.  Although  the  insertion  of  a 100  Hz  bandpass 
filter  raises  the  SNR  to  0 dB,  the  relative  invariance  of 
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TABLE  II 


OPERATOR  PERFORMANCE  DATA 


(a)  Speed: 

35  wpm 

* 

BW 

SNR 

(dB) 

SNR 

(dB) 

(in 

given  BW) 

(in  signal 

2 kHz 

-13 

0 

200  Hz 

-3 

0 

100  Hz 

0 

0 

2 kHz 

-10 

3 

200  Hz 

0 

3 

100  Hz 

3 

3 

2 kHz 

-7 

6 

200  Hz 

3 

6 

100  Hz 

6 

6 

ERROR  RATE  (%) 

COMMENTS 

OP1 

OP2 

12 

15 

difficult  and 

11 

13 

fatiguing 

12 

14 

EW  too  narrow 

6 

10 

fatiguing 

11 

9 

BW  too  narrow 

11 

10 

1 

2 

relatively  easy 

0 

1 

prefei:  wider  BW 

2 

2 

(b)  Speed:  25  wpm 


BW 

SNR 

(dB) 

(in  given  BW) 

2 kHz 

-13 

200  Hz 

-3 

100  Hz 

0 

2 kHz 

-10 

200  Hz 

0 

100  Hz 

3 

2 kHz 

-7 

200  Hz 

3 

100  Hz 

6 

SNR  ERROR 

<dB) 

(in  signal  BW)  OP1 

2 6 

2 7 

2 8 

5 2 

5 1 

5 2 


! (%)  COMMENTS 

OP2 

5 difficult  and 

6 fatiguing 
5 

1 relatively  easy 

1 but  still  mildly 

2 fatiguing 

0 
1 
2 


8 

8 

8 


1 

0 

0 


easy  enough 


error  rates  with  changes  in  filter  bandwidth  indicates  that 
the  ear  performs  the  necessary  filtering.  Strict  concentration 
is  required,  however,  at  this  low  SNR,  and  the  test  operators 
stated  they  would  not  attempt  to  copy  such  a signal  unless 
strongly  motivated. 

Using  the  previously  defined  signal  bandwidth  for  each 
speed,  the  results  may  be  summarized  as  follows:  An  operator 

can  provide  copy  with  a 10" 15%  error  rate  with  an  SNR  of 
approximately  0 dB  in  the  signal  bandwidth;  at  3 dB,  the 
error  rate  is  5-10%;  and  at  6 dB,  copy  is  practically  perfect. 

Based  on  these  results,  it  seems  reasonable  to  assert 
that  a typical  field  operator,  faced  with  searching  for  and 
copying  morse  traffic  eight  hours  a day,  would  not  be  inclined 
to  copy  signals  much  below  6 dB  SNR  in  the  signal  bandwidth 
unless  absolutely  required.  Thus  the  system  designer  must 
select  from  two  costly  alternatives:  1)  If  he  designs  the 

system  to  perform  as  well  as  the  good  operator  i£  able  to 
perform,  the  automated  system  will  reliably  receive  a large 
percentage  of  signals  encountered  on  the  air,  but  it  is  likely 
to  be  complex  and  expensive.  2)  On  the  other  hand,  if  he 
designs  the  system  to  perform  as  well  as  a typical  operator 
probably  performs,  the  automated  system  will  be  cheaper,  but 
the  remaining  operators  who  must  copy  the  low  SNR  signals 
which  are  not  machine  transcribable  may  become  too  fatigued 
to  be  efficient,  leaving  the  overall  man/machine  surveillance 
system  less  effective  than  the  existing  manual  system. 

Such  design  considerations  are  beyond  the  scope  of  this 
thesis;  using  the  "good"  operator  as  a criterion,  the 
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ultimate  system  design  objectives  may  be  broadly  stated  as 
follows : 

1)  With  an  error  rate  of  10%  or  less,  recover  and 
decode  morse  signals  whose  SNR  in  a 2 kHz  bandwidth 
is  on  the  order  of  -10  dB,  using  standard  code  with 
additive  white  gaussian  noise  and  no  interference. 

2)  Track  the  time-varying  statistics  of  character 
lengths  in  order  to  enable  the  transcriber  to 
translate  the  code  properly. 
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IV.  PROCESSOR  DESIGN  PHILOSOPHY 


The  first  step  in  the  processor  design  was  to  model  the 
morse  code  as  a random  telegraph  wave  with  non- stationary 
transition  probabilities.  Using  this  model,  several 
increasingly  complex  processing  methods  were  implemented, 
and  the  processing  gain  of  each  stage  was  determined.  First 
a Kalman  filter  was  designed  to  filter  the  demodulated 
output  of  a square-law  detector  with  and  without  narrowband 
analog  IF  filtering.  Next  a smoothing  algorithm  was  added 
to  determine  the  effectiveness  over  Kalman  filtering  alone. 
Finally  a maximum  a posteriori  (MAP)  estimator  of  the  code 
characters,  using  the  smoothed  output  for  likelihood 
calculation,  and  using  the  Viterbi  algorithm  for  processing, 
was  programmed  and  tested. 

After  determination  of  the  error-reduction  effectiveness 
of  each  of  these  processing  stages,  a more  general  model 
of  the  signal  process  was  used  to  design  a Kalman  filter  for 
pre-detection  filtering.  The  objective  was  to  determine 
whether  or  not  such  filtering  yielded  any  advantage  over  the 
simpler  demodulation/post-detection  filter  approach.  A block 
diagram  of  the  various  stage  is  shown  in  Figure  4.  Sections 
V through  VII  present  a theoretical  basis  for  each  of  the 
processing  stages,  followed  by  a presentation  and  discussion 
of  experimental  results. 


Smooth 


Demo  a 


V.  BASEBAND  MODEL  AND  PROCESSOR 


The  baseband  morse  signal  may  be  modeled  as 

x(k+l)  = x(k)  + w(k)  (V-l) 

where  x = key  state  (0  or  1),  and  w(k)  is  a random  forcing 
function  descriptive  of  the  morse  keying  process.  At  the 
output  of  the  demodulator,  the  signal  is  observed  as 

z(k)  = x(k)  + v(k) 


where  z(k)  is  the  observed  value  and  v(k)  is  the  additive 
noise.  This  model  gives  rise  to  the  following  scalar 
Kalman  filter  algorithm  13],  [4]: 


G(k) 


V(klk-l) 

V (k |k-l)  + R 


(gain) 


V(kjk)  = [1  - G(k) )V(k |k-l)  (estimation  variance) 


V(k+l|k)  = V (k | k)  + Q(k) 


(prediction  variance) 


x(k|k)  = x(k |k-l)  + G(k)[z(k)  - x(k|k-l)] 

(estimation) 

A A 

x(k+l|k)  = x(kjk)  (prediction) 
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where : 


A 

x(k)  = estimate  of  x at  time  k 
R = variance  of  the  observation  noise,  v(k) 

Q(k)  = variance  of  the  random  forcing  function,  w(k).. 

Since  this  algorithm  implies  knowledge  of  the  variances  R 
and  Q,  procedures  for  their  estimation  are  required.  In 
order  to  keep  the  filter  algorithm  itself  as  simple  as 
possible,  estimates  of  Q and  R were  made  independently,  and 
used  by  the  filter  algorithm  as  if  these  were  the  true  values. 

A.  ALGORITHM  FOR  ESTIMATING  THE  RANDOM 
FORCING  FUNCTION  VARIANCE 

The  random  forcing  function  w(k)  is  descriptive  of  the 
on-off  keying  process,  i.e.,  it  may  be  thought  of  as  the 
process  which  causes  the  transitions  in  the  x state  from 
0 to  1 and  from  1 to  0.  Referring  to  the  signal  model 
equation  (V-l) , the  keying  process  has  the  following 
interpretation:  If  x(k)  = 0 and  w(k)  = 0,  then  x(k+l)  = 0 

and  x remains  in  the  space  condition.  If,  on  the  other  hand, 
w(k)  = 1,  x shifts  (at  time  k+1)  from  the  space  condition  to 
the  mark  condition.  This  process  is  illustrated  in  Figure  5. 
Since  the  probability  of  occurrence  of  a transition  is 
dependent  on  the  time  duration  since  the  last  transition, 
this  probability  is  non-stationary . A proper  description  of 
the  transition  probabilities  at  each  time  k,  then,  must 
necessarily  be  time  dependent  and  conditioned  on  the  element 


duration  and  the  present  state.  The  following  probabilities 
are  therefore  required: 

P(w(k)=0 |k,x{k)=l)  = Pr [remain  in  mark  condition]  (V-2) 
P(w(k)=l|k,x(k)=l)  = 0 (V-3) 
P(w(k)=-l|k,x(k)=l)  = Pr [transition  from  mark  to  space]  ( V—  4) 
P(w(k)  =0  |k,x(k)  =0)  = Pr [remain  in  space  condition]  ( V— 5) 
P(w(k) =l|k,x(k) =0)  = Pr [transition  from  space  to  mark]  (V-6) 
P (w(k) =-l |k ,x(k) =0)  = 0 (V-7) 


Probabilities  (V-3)  and  (V-7)  are  identically  zero  since 
state  values  less  than  0 and  greater  than  1 are  not  allowable. 
The  remaining  probabilities  are  dependent  on  the  distributions 
of  dot,  dash,  element-space,  letter-space,  and  word-space 
durations  of  the  particular  morse  signal  being  received,  and 
are  dependent  in  a Markov  sense  on  the  previous  character. 

The  Markov  nature  of  the  code  character  transitions  was  not 
taken  advantage  of  in  the  filtering  process.  Additionally 
it  was  assumed  that  a particular  operator's  character 
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durations  are  all  distributed  with  uniform  density,  that 
the  dot  and  element  space  have  the  same  density,  and  that 
the  dash  and  letter  space  have  the  same  density.  The 
assumed  densities,  as  shown  in  Figure  6,  presume  for  the 
present  that  the  mean  values  T,  T^,  and  the  parameters  l,  d 
are  either  known  or  have  been  determined  in  some  manner. 

Although  the  assumption  of  uniform  densities  for 
the  character  durations  of  any  particular  sending  operator 
is  probably  not  strictly  justifiable,  neither  is  the 
assumption  of  any  other  well-known  density,  such  as  a 
gaussian  or  exponential  density.  The  most  likely  candidate 
for  properly  modeling  these  duration  distributions  may  be 
a gaussian-like  density  with  the  tails  truncated  at  suitable 
values.  The  complexity  of  estimating  the  parameters  of 
such  a density  for  a particular  received  signal,  together 
with  the  computational  burden  of  evaluating  the  error 
function,  erf(t),  for  the  probability  calculations  (V-2) 
through  (V-7)  at  each  sample  point,  motivated  the  selection 
of  the  uniform  density.  The  resulting  probability  computations 
are  relatively  simple  and  straightforward. 


JttmFSSSm 


a)  Dot/Element-space  Duration  Density 
lot'1) 


b)  Dash/Letter-space  Duration  Density 


Figure  6.  Character  Duration  Densities 


1.  Mark  Transition  Probabilities 


A description  of  probabilities  (V-2)  and  (V-4)  may 
be  obtained  by  first  conditioning  on  the  dot  and  dash 
probabilities,  and  noting  that  if  x(k)  is  still  in  the  mark 
condition  after  T+£, , then  the  mark  is  known  to  be  a dash. 
Given  then  that  a mark,  m,  is  a dot,  and  given  T and  £, 
probability  (V-2)  may  be  modeled  as 

T+A 

PQl(dot)  = P<w(k)=0  |k,T,x(k)=l,m=dot)  = / Pdot^  dt 

k 

1 ; 0 < k < T-A 

- + I ' T-£  i k 1 T+£ 

0 ; T+l  < k 


Similarly,  for  a dash: 


T.+d 

A ° 

PQ1(dash)  = P(w(k)=0  jk,Td,x(k)=l,m=dash)  = / Pdash*^  dt 


0 < k < Td-d 

Td“d  1 k i Td+d 
T^+d  < k 
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Here  k is  the  time  index  which  counts  the  number  of  units 
the  signal  has  been  in  the  mark  condition  on  the  present 
mark.  ‘ The  conditioning  on  to  must  he  removed  for  0 £ k £ T+£ 
since  m is  not  known  during  this  interval.  Thus  for  k < T+£: 


P(w(k)=0 |k,T,x(k)=l) 
and  for  k > T+i, 


PQ^(dot) Pr(dot)  + PQ1(dash) Pr(dash) 

(V-8) 


P(w(k)=0 |k,Td,x(k)=l)  = PQ1(dash)  . 


(V— 9 ) 


But  the  dot  and  dash  probabilities  are  dependent  on  the  type 
of  traffic  in  the  message,  i.e.  on  what  language  the  message 
is  in,  whether  it  is  plain  text  or  code  groups,  letters  only 
or  both  letters  and  numbers,  etc.  Since  the  traffic  type 
may  not  be  known  a priori,  equiprobable  dots  and  dashes  were 
assumed  at  this  point.  Using  Pr(dot)  = Pr(dash)  = 1/2,  then, 
equations  (V-8)  and  (V-9)  reduce  to 


T^k  3 
"4*  4 


P(w(k)=o|k,T,T.,x(k)=l)  = 1 


Vk  + 1 

T3"  + 7 


0 1 k < T-£ 

T— £ < k < T+£ 
T+£  < k < Td~d 
Td-d  < k < Td+d 
Td+d  < k 
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Probability  (V-6)  follows  immediately  as 


P(w(k)=-l|k,T,Td,x(k)=l)  =1-  P(w(k)=0|k,T,Td,x(k)=l)  . ■ 

The  expression  for  probability  (V-2)  as  a function  of  time, 
k,  conditioned  on  the  present  state  and  dot  and  dash 
distributions  is  sketched  in  Figure  7. 

2 . Space  Transition  Probabilities 

An  appropriate  description  for  the  space  duration 
probabilities  (V-4)  and  (V-7)  is  derived  similarly,  first  by 
conditioning  on  a particular  space  and  then  removing  the 
appropriate  conditioning  by  using  the  relative  frequencies 
of  each  space.  Given  that  a particular  space,  s,  is  an 
element-space,  then, 


1 


0 < j < T-5, 


P(w(j)=0 |x(j)=0,s=elem,T)  = 


1 

7 


T-5,  < j < T+5, 


0 


T+5,  < j 


(V- 


where  j is  the  time  index  which  counts  the  number  of  units 
the  signal  has  been  in  the  space  condition  on  the  present 
space;  and  the  element  length,  given  T,  is  assumed  to  have 
the  same  uniform  density  as  the  dot  length. 
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Figure  7.  Mark  Probability  (V-2)  as  Function 


Similarly  for  a letter-space: 


P(w(j)=0 jx(k)=0/s=ltr-sp,Td)  = 


1 


0 < 3 £ Vd 


2d 


Td"d  i 3 1 Td+d 


0 


Vd  i 3 


(V-ll) 


where  j is  the  same  index  as  above  and  the  letter-space 
length,  given  T^,  has  the  same  density  as  the  dash- length. 

For  the  word-space  it  was  decided  to  use  an 
exponential  model,  since  after  about  5T  units,  th«=  rord-space 
is  (in  actual  practice)  about  equally  likely  to  end  at  any 
time: 

1 0 < j _<  5T 

P(w(j)=0 |x( j)=0,s=word-sp,T)  = 

v 2t  ' 

e 5T  £ j < 00 


(V-12 ) 
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The  conditioning  on  s may  be  removed  by  observing  that  if 
j > Td+d,  the  space  must  be  a word-space;  if  j > T+Jl,  then 
the -space  is  a word-space  or  letter-space.  In  equiprobable 
letter  traffic,  the  needed  probabilities  are: 

Pr(s=elem-space)  =12/17 
Pr (s=letter-space)  = 4/17 
Pr(s=word- space)  = 1/17 

Applying  these  probabilities  then  to  (V-10) , (V-ll) , and 
(V-12)  yields  the  desired  expression: 

P(w(j)=0  |j,T,Td,x(j)=0)  = 

1 0 < j < T-i, 

T-Jl  < j < T+fc 
T +«,  < j < Td-d 


Td-d  < j < Td+d 


The  variance  of  w(k)  is  now  easily  calculated  at 
each  time,  k,  as  follows: 

Let 

Pk(0,l)  = Pr (w(k)  =0  | x(k)=l) 

Pk(-l,l)  £ Pr(w(k)  =-l | x(k)  =1) 

Pj(0,0)  = Pr  (w(  j)=0  |x(  j)=0) 

Pj(l,0)  ^ Pr (w( j ) =1 | x( j ) =0)  . 

Then,  if  x(k)  = 1, 

Q(k)  = (0)  2 ' ?k  (0 , 1)  + (-D2-Pk(-l,l)  - [E  (w  (k) ) ] 2 
« Pk(-l,l)  - [-Pk(-l,l)]2 
= Pk(-l,l) -Pk  (0,1)  . 

Similarly,  if  x(j)  = 0, 

Q( j)  = Pj(0,0) -Pj (1,0) . 

Since,  at  the  receiver,  the  true  state  x(k)  is  not 
known,  correct  estimates  of  Q are  dependent  on  correct 
estimates  of  the  state,  x(k).  Thus,  it  is  expected  that  at 
some  SNR,  incorrect  estimates  of  x(k)  will  cause  the 
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estimates  of  Q to  be  erroneous  enough  to  force  incorrect 
estimates  of  x(k+l) , causing  a runaway  condition  to  develop 
and  yield  the  receiver  worthless.  This  SNR  at  which.. runaway 
develops  was  determined  experimentally,  and  found  not  to  be 
a serious  problem. 

B.  CHARACTER  DISTRIBUTION  ESTIMATION 

It  was  assumed  that  the  character  distributions  are 
appropriately  described  by  uniform  densities  with  known 
parameters  (expect  for  mean  values) . More  sophisticated 
methods  of  distribution  and/or  parameter  estimation  were 
discarded  in  favor  of  simplicity.  Experience  suggests  that 
even  a sloppy  sender  will  usually  not  exceed  an  i./T  or  d/'T^ 
ratio  of  about  1/3.  Thus,  once  estimates  of  T and  Td  are 
obtained,  % and  d can  be  determined  from  this  assumption 
unless  these  ratios  are  known  in  advance.  The  mean  values 
T and  Td  of  dot  or  element-space  and  dash  or  letter-space, 
respectively,  were  estimated  by  measuring  the  character 
durations  and  sequentially  averaging  the  appropriate  duration. 
Thus  T is  the  mean  value  of  the  dot  and  element-space  durations 
and  T^  is  the  mean  value  of  the  dash  and  letter-space  durations 
The  threshold  for  deciding  which  set  of  measurements  a 
particular  length  belongs  to  was  set  at  the  halfway-point 
between  dot  and  dash  lengths.  The  algorithm  is  as  follows: 
Initially  specify: 

t^  = shortest  dot-duration  expected, 

t2  = longest  dot-duration  expected, 
with  t2  £ 3t1. 


1.  (a)  Initialize  estimate  of  T as  (t^+t2)/2, 

(b)  Initialize  estimate  of  Td  as  (3^+3^! /2. 

2.  Measure  the  duration  of  each  mark  and  space. 

3.  If  the  measured  value  is  less  than  (3t^+t2)/2,  then 
identify  it  as  a dot/element  duration,  T^. 

4.  If  the  measured  value  is  larger  than  (3t1+t2)/2,  then 
identify  it  as  a dash/letter-space  duration,  T2. 

5.  Estimate  the  means  recursively  by 

(a)  T(k)  = T{k-1)  + i [T1  - T(k-l)  ] . 

(b)  Td(k)  = Td(k-1)  + £ [T2  - Td(k-1)]  . 


C.  OBSERVATION  NOISE  VARIANCE 

Although  the  noise  power  used  in  each  of  the  tests  was 
known  and  could  have  been  specified  initially,  it  was 
decided  to  estimate  this  parameter  in  order  to  better 
simulate  an  operational  environment  where  the  noise  power 
is  not  known  a priori.  Although  the  method  is  purely 
intuitive  and  without  a valid  theoretical  basis,  reasonably 
good  results  were  obtained. 

At  the  output  of  the  square-law  demodulator,  the  noise 
is  no  longer  gaussian  and  is  correlated  with  the  signal. 
Proceeding,  however,  as  if  the  signal  and  noise  were  not 
correlated,  the  noise  variance  R can  be  obtained  by  sub- 
tracting the  morse  signal  power  from  the  total  received 
(demodulated)  signal  power: 


A 


A 


R = 


A 

where  V is  obtained  recursively  by  the  following: 
2 

Vz(k)  = Vz(k-1)  + i [ (2-Gz) 2 - Vz(k-1)] 


and 

A 

u = mean  value  of  the  received  (demodulated)  signal 
2 
A 

a = estimate  of  demodulated  signal  amplitude. 


The  parameters  y_  and  a were  also  estimated  on  line,  although 
they  too  are  known  a priori  for  test  purposes.  The  estimator 
algorithm  for  a is 


1) 

a^  (k)  = aj^tk-l) 

[z  (k) 

- a1 (k-1) ] 

if 

A 

z (k)  > Mz 

(2) 

a2(k)  = a2(k-l) 

[z  (k) 

- a2 (k-1) ] 

if 

A 

z(k)  < yz 

(3)  a(k)  = a^k)  - a2  (k)  . 


A 

The  mean  value,  u , is  simply 

z 


Vz(k)  = u2(k-l)  + £ [ z (k)  - yz  (k-1)  ] . 


D.  SMOOTHING  ALGORITHM 


The  Kalman-filtered  output  represents  the  optimum 
linearly-filtered  estimate  of  the  signal  amplitude  in  the 
minimum  mean-square-error  sense  based  on  the  assumed  model 
and  the  efficiency  and  consistency  of  the  estimated 
statistics.  This  estimate  may  be  improved,  however,  by 
smoothing  the  data,  which  implies  consideration  of  future 
inputs  as  well  as  past  inputs  [4]. 

The  equations  for  the  discrete  optimal  linear  fixed- 
interval  smoother,  for  the  scalar  case,  expressed  as  a 
combination  of  a forward-running  filter  and  backward-running 
filter  are  given  by  [5],  [6]  as: 

Smoothed  Estimate: 


x(k|N)  = P(k|N).[x{k|k)/Pf(kjk)  + Xjjtklk+D/Pj^tklk+l)] 


Estimation  Variance: 


p(k|H)  = r/p£ oi'[k) — t i7F^nrpi+Ty 


where 

a 

x(k|k)  = filtered  state  estimate 
Pf(k|k)  = error  variance  for  the  forward  filter 
x^tkjk+l)  = (predicted)  estimate  for  the  backward  filter 
P^tkjk+l)  = (predicted)  error  variance,  backward  inter. 
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These  expressions  are  not  computationally  suitable,  however, 

| 

since  Pb(k|k+1)  is  not  finite  when  k = N.  Alternate 

] 

expressions  [6]  which  are  more  amenable  to  computation  are  ^ 

l 

given  as  follows: 


Pf(k|k) 

Let  W(k)  = 1 + Pf (k|k)/Pb(k|k+l)  * 

i 

| 

Then 

I 

P (k | N)  = [1  -W(k)/Pb(k|k+1)  ]2-Pf(k|k)  • [W2(k)/Pb(k|k+1)  ] 

I 

j 

and 


1/Pfa(k|k+1)  = 0 when  k = N . 


Let  Wb(k|k+1)  = x^k  jk+l)/Pb  (kjk+1)  . 


Then 


x(k|N) 


x(v  | k) 

[1  + Pf  (k|k)/Pb(k|x+l)  ] + P(k|N)WD(k|k+l) 


and 


P(k|N)Wb(k|k+l)  = 0 when  k = N . 
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These  equations  then  represent  the  smoothing  algorithm. 

As  noted  above,  forward- filtered  estimates  must  be  stored 
until  the  same  data  can  be  backward-filtered  and  combined 
to  produce  the  smoothed  state  estimate. 

The  smoothed  state  estimate  then  is  the  best  (linear) 
estimate  possible  for  the  given  model  and  parameter  estimators, 
and  any  improvement  in  error  rate  must  be  derived  from  giving 
more  probabilistic  structure  to  the  signal  model. 

E.  IMPLEMENTATION  OF  FILTER  AND  SMOOTHER 

A diagram  of  the  test  signal  generation  method  is  shown 
in  Figure  8.  The  square- law  demodulator  was  selected  simply 
for  ease  of  implementation  since  an  analog  squarer  and 
appropriate  filters  were  readily  avai  iable  and  easily  inter- 
faced with  the  analog-to-digital  converter.  The  100  Hz 
low-pass  filter  permits  recovery  of  morse  signals  of 
approximately  35  wpm  or  less.  The  signal-to-noise  ratios 
used  throughout  this  report  are  average  (pre-detection) 
signal-to-noise  power  ratios  and  not  pulse  signal  power  to 
noise  power  ratios.,  More  specifically,  the  average  signal 
power  in  the  morse  signal  is  defined  as 

2T 

Ps  = A Q;  dt 

where  the  interval  (0 , 2T]  is  a dot  and  element-space.  This 
expression  reduces  to 


Signal  Amplitude 
Measurement 


T 2T 

Ps  ■ jjf  / (a  cos  ait)2  dt  + I 0 dt 

Ps  = a2/4  , 


which  is  3 dB  less  than  the  pulse  signal  power. 


The  noise  signal  is  taken  from  a calibrated  white  gaussian 
noise  source  of  1 volt  rms. 

The  filter  and  smoother,  along  with  the  auxiliary 
estimation  algorithms,  were  coded  in  Fortran  and  implemented 

4 

on  the  XDS-9300  computer  interfaced  with  the  CI-5000  analog 
computer  for  analog  filtering  and  for  D/A  and  A/D  conversion. 

The  sampling  rate  was  500  samples  per  second,  and  the  value 
of  N for  smoothing  was  chosen  to  be  250  samples.  The  sampled 
test  signal  was  recorded  on  tape  for  subsequent  processing, 
since  the  processing  required  approximately  4 seconds  for 
1 second  of  data.  The  test  signal  runs  consisted  of  the 
following: 

1.  Perfect  code  AR  sequence  and  random  letter  sequence  at 
speeds  of  35,  30,  and  25  wpm  each  with  a signal-to-noise 
ratio  of  6,  5,  4,  3,  2,  and  1 dB  in  a 2 kHz  BW  with  no 
pre-detection  analog  filtering. 

2.  Perfect  code  AR  sequence  and  random  letter  sequence  at 
speeds  of  35,  30,  and  25  wpm  each  with  a signal-to-noise 
ratio  of  -7,  -8,  -9,  -10,  -11,  -12  dB  in  a 2 kHz  BW  with 
a 100  Hz  pre-detection  analog  bandpass  filter. 
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3.  Sloppy  code  AR  sequence  at  nominal  speeds  of  25  and  30 

wpm  each  with  a signal-to-noise  ratio  of  6,  5,  4,  3,  2, 

1 dB  in  a 2 kHz  BW  with  no  pre-detection  filtering- 

4.  Sloppy  code  AR  sequence  at  nominal  speeds  of  25  and  30 
wpm  each  with  a signal-to-noise  ratio  of  -7,  -8,  -9, 

-10,  -11,  -12  dB  in  a 2 kHz  BW  with  a 100  Hz  pre-detection 
analog  bandpass  filter. 

The  output  of  the  processor  was  recorded  on  an  8-channel 

strip-chart,  using  a utility  D/A  conversion  routine.  The 

* 

outputs  were  as  follows: 

Channel  1:  Recorded  input  signal 

Channel  2:  Unprocessed  output  (input  signal  thresholded 

at  its  mean  value) 

Channel  3:  Kalman  filtered  output 

Channel  4:  Filtered  output  thresholded  at  0 V. 

Channel  5:  Smoothed  output 

Channel  6:  Smoothed  output  thresholded  at  0 V. 

Channel  7:  Option  of  filter  gain  or  noise  variance  estimate 

Channel  8:  Dot/element- space  duration  estimate. 

The  following  figures  (9-19)  are  typical  output  records, 
showing  examples  of  the  test  runs  for  each  signal  and  type 
of  sequence.  Channels  1-4  are  shown  in  Figure  (a)  in  each 
case  with  the  corresponding  channels  5 and  6 shown  in  Figure 
(b) . An  example  of  the  output  of  channel  7 for  the  gain 
option  is  shown  in  Figure  20,  along  with  the  corresponding 
outputs  from  channels  1,  3,  and  4.  Figure  21  shows  an 
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example  of  the  outputs  for  the  noise  variance  estimate  and 
the  dot/element- space  duration  estimate  at  a point  where  the 
input  signal  changes  from  25  to  30  wpm  and  the  signal- to- 
noise  ratio  changes  from  1 dB  to  6 dB.  In  all  cases  the 
chart  speed  was  10  mm/sec  except  in  Figure  21  where  5 mm/sec 
was  used  in  order  to  show  the  estimates  more  clearly.  The  scales 
for  channels  1,  2,  4 and  6,  and  for  channel  7 gain  option , 
are  5 v./div. , with  100  volts  corresponding  to  a variable 
value  of  1.0;  the  scales  for  channels  3 and  5 are  2 v./div. 

For  the  channel  7 variance  option  the  scale  is  200  mv./div., 
and  for  channel  8 the  scale  was  calibrated  at  4 msec/div. 

F.  RESULTS  OF  TESTS 

The  outputs  of  the  processor  were  decoded  by  hand  to 
determine  the  error  rates.  Using  the  estimate  of  T,  a mark 
was  decoded  as  a dot  if  its  duration  was  2T  or  less  and  as 
a dash  otherwise.  Similarly,  a space  was  decoded  as  an 
element-space  if  its  duration  was  2T  or  less,  as  a letter- 
space  if  the  duration  was  between  2T  and  4T,  and  as  a word 
space  otherwise. 

The  following  data  were  obtained  for  each  run; 

1.  Letter  error  rate  and  bit  error  rate  with  no  processing. 

2.  Same  error  rates  with  filtering  only. 

3.  Same  error  rates  with  filtering  and  smoothing. 

A letter  error  occurs  when  any  transmitted  letter  is  not 
correctly  decoded.  Only  one  error  per  transmitted  letter 
is  counted;  for  example,  if  "A"  is  decoded  as  "ET",  one 
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letter  error  has  occurred.  On  the  other  hand,  if  "ET"  is 
decoded  as  "A",  two  errors  have  occurred,  since  neither  "E" 
nor  "T"  was  decoded  correctly.  Word  spaces  are  counted  as 
one  letter  per  7 elements.  The  sample  size  in  each  case  wan 
approximately  200  letters.  A bit  error  is  defined  as  at 
least  one  mark-space  error  occurring  within  a transmitted 
element  duration.  Again,  only  one  error  per  element  is  counted, 
and  the  sample  size  was  approximately  200  bits. 

The  results  of  this  analysis  are  presented  in  Tables  III 
through  VI.  Column  1 lists  the  signal-to-noise  ratio  used 
without  a 100  Hz  pre-detection  filter;  column  2 lists  the 
signal-to-noise  ratio  used  with  the  100  Hz  filter  in  place. 

Both  the  bit  and  letter  error  rates  for  filtering  and 
smoothing  are  tabulated,  with  the  error  rates  for  the 
unprocessed  output  shown  for  comparison.  In  each  case,  the 
error  rates  are  shown  for  the  typical  (random  letter) 
sequence  and  the  AR  sequence,  except  in  Table  VI,  where  the 
results  are  for  the  AR  sequence  only  since  no  random  letter 
sequence  for  this  case  was  recorded.  Table  VII  shows 
typical  hand- translated  sequences  for  each  processing  stage. 

These  results  indicate  that  the  Kalman  filter  and  linp_r 
smoother  provide  a significant  decrease  in  both  bit  and 
letter  error  rates.  By  using  a 100  Hz  bandpass  pre-detection 
filter,  such  processing  provides  a tolerable  10%  letter  error 
rate  on  a -7  dB  SNR  signal  as  opposed  to  an  unacceptable 
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5IGURE  9b.  Sraoothed  Output  for  35  wpm  Sequence,  6 <33  SNR 
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FIGURE  10b.  Smoothed  Output  for  35  wpm  Sequence,  5 dB  SNR 


Output  for  35  wpm  AR  Sequence 


Channel 


FIGURE  12a.  Filter  Output  for  35  wpm  Typical  Sequence,  6 dB  SNR 
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Smoothed  Output  for  35  wpm  Typical  Sequence,  6 dB  SNR 


Channel 


FIGURE  13a.  Filter  Output  for  35  wpm  Typical  Sequence 
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FIGURE  13b.  Smoothed  Output  for  35  wpm  Typical  Sequence,  4 dB  SNR 
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Filter  Output  for  30  wpm  AR  Sequence 


Smoothed  Output  for  30  wpm  AR  Sequence 
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FIGURE  15a.  Filter  Output  for  25  wpm  AR  Sequence,  5 dB  SNR 
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Output  for  2 5 wpm  AR  Sscjuencs 
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FIGURE  16b.  Smoothed  Output  for  25  wpm  AR  Sequence,  3 dB  SNR 


Channel 


64 


S lopp; 


V 


65 


FIGURE  17b.  Smoothed  Output  for  25  wpm  Sloppy  Code  AR  Sequence,  6 dB  SNR 
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L9b.  Smoothed  Output  for  25  wpm  Sloppy 


Filter  Gain  (Channel  7)  4 dB  SNR 


IGURE  21.  Noise  Variance  and  Estimate  of 
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ERROR  RATES  FOR  SLOPPY  CODE 


120-150  msec 
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TABLE  VII 

TYPICAL  TRANSLATED  SEQUENCES 


SENT  QA  Z WS  X E DC  R F V T GB  YHN  UJM 
UNPROCESSED  ??  ? E WH  XEIED?  E FFV  T GG  E YHN  FJM 
FILTERED  ??  ? E WH  X IEDC  E RFV  T GG  YHN  UJM 
SMOOTHED  ??  ? WH  X E DC  E RFV  T GB  YHN  UJM 


SENT 

QAZ 

WS 

X 

E 

DC 

RFV  T 

GB 

YHN  UJM 

UNPROCESSED 

IEQAZ 

PSEX 

I 

DCEFF7EA 

GBEYHNEU?? 

FILTERED 

IEQAZ 

?? 

X 

I 

DC 

FFVIT 

GB 

YHN  UJM 

SMOOTHED 

EEQAZ 

?? 

X 

T 

DC 

RF?  T 

GB 

YHN  UJM 

SENT 

QAZ 

WSX 

E 

E 

DC 

RFV  T 

GB 

YHN  UJM 

UNPROCESSED 

QUAD 

??XEEI 

I 

DC 

E 

LPVET 

PBEYHNE? JME 

FILTERED 

QMZ 

WHXEEI 

I 

DY 

E 

RFV  T 

GB 

YUN  F?ME 

SMOOTHED 

QAZ 

WHX 

I 

I 

DC 

RFV  T 

GB 

QUNEUJM 

SENT 

QAZ 

WS  X 

E 

DC 

RFV  T 

GB 

YHN  U 

UNPROCESSED 

Q?EZ 

E 

LS  X 

EIH 

?? 

LFVIA 

GB 

E YH?EV 

FILTERED 

QAZ 

E 

WS  X 

EEE 

DC 

E 

RFVET 

GB 

YHN  U 

SMOOTHED 

QAZ 

WS  X 

E 

D? 

E 

RFV  T 

GB 

YHN  U 

SUMMARY : 


Error  Rate 


total  letters  sent 

125 

- 

unprocessed  errors 

58 

46% 

filtered  errors 

31 

25% 

smoothed  errors 

19 

15% 

(question  marl;  indicates  untranslatable  sequence) 

BW  = 2 kHz  SNR  = 5 dB  speed  = 30  wpm  perfect  code 
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32-34%  error  rate  without  processing.  Smoothing  contributes 
considerably  to  a reduced  error  rate  down  to  about  -9  dB 
where  its  effectiveness  over  filtering  alone  begins  to  fall 
off.  For  the  high  speed  35  wpm  signal,  runaway  of  Q estimation 
occurs  at  approximately  -9  dB,  while  for  the  lower  speeds 
runaway  never  really  develops  until  the  SNR  reaches  -12  dB, 
since  filtering  always  provides  an  improvement  in  error  rate 
even  at  these  low  SNR's. 

It  was  noted  that  a majority  of  the  errors  in  the  filtered 
and  smoothed  output  result  from  insertions  of  isolated  dots 
in  the  letter-space  and  particularly  the  word-space  separations. 
A possible  remedy  to  this  situation  is  to  incorporate  the 
Markov  structure  of  the  code  in  the  estimation  algorithm  for 
Q,  although  an  increased  susceptibility  to  runaway  may  limit 
its  effectiveness. 

Since  the  bit  error  rate  must  be  on  the  order  of  1%  or 
less  in  order  to  yield  a tolerable  10%  letter  error  rate, 
it  was  felt  that  bit  error  rates  of  up  to  approximately  3% 
could  possibly  be  reduced  to  an  acceptable  level  by  use  of 
soft-decision  Viterbi  decoding  following  the  smoothed  output. 

If  such  a reduction  were  possible,  then  acceptable  error 
rates  could  be  obtained  for  SNR's  down  to  -9  dB. 

Additionally,  pre-detection  Kalman  filtering  and  parameter 
estimation  would  yield  a theoretical  gain  of  3 dB  or  more 
over  non-coherent  demodulation.  With  these  improvements  in 
the  processor,  then,  the  output  letter  error  rate  of  10% 
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could  be  achieved  on  signals  whose  SNR  is  on  the  order  of 
-12  dB  in  a 2 kHz  bandwidth  and  the  originally  stated  design 
objective  would  be  met. 

Both  of  these  possible  improvements  were  implemented 
separately  to  determine  the  effectiveness  of  each  one.  The 
Viterbi  decoder  algorithm  used  the  smoothed  output  of  the 
post-detection  Kalman  filter  as  input.  A separate  program 
was  written  to  implement  a pre-detection  Kalman  filter. 
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VI.  VITERBI  DECODER 


The  Viterbi  algorithm  [7],  [8],  as  originally  formulated, 
is  a maximum  likelihood  (ML)  sequence  estimation  decoding 
algorithm  for  convolutional  codes.  It  has  found  application 
in  other  areas  [9],  however,  and  its  use  has  been  extended 
to  maximum  a posteriori  (MAP)  estimation.  It  is  the  MAP 
estimation  use  which  is  of  importance  here. 

A.  MAP  ESTIMATION 

In  order  to  transform  the  smoothed  output  of  the 
processor  into  characters  of  the  morse  code,  certain 
decision  criteria  must  be  formulated.  The  easiest  and  most 
obvious  way  to  accomplish  decoding  is  to  threshold  the 
smoothed  output  at  its  mean  value  and  determine  the  identity 
of  marks  and  spaces  on  the  basis  of  the  measured  duration 
of  each  received  character.  Such  a scheme,  however,  fails 
to  utilize  two  sources  of  information  which  are  inherent 
in  the  smoothed  output:  1)  Thresholding  discards  all 

information  present  in  the  actual  smoothed  amplitude  estimate, 
and  2)  the  Markov  nature  of  the  character  transitions  is  not 
utilized. 

The  decoding  problem,  then,  is  to  take  advantage  of  this 
additional  information  to  determine  the  most  probable 
sequence  of  morse  characters.  The  thresholded  output  may  be 
used  to  make  tentative  decisions  to  obtain  a specific 
sequence  of  character  outputs  z , ...,zn,  where  a particular 
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z^  is  either  a dot,  dash,  element-space,  or  letter-space. 
It  is  the  objective,  then,  to  find  a specific  sequence  of 
transmitted  characters  xQ,...,xn  which  maximizes  the 
probability  that  xQ, . . . ,xn  was  transmitted,  given  that 

zo zn  was  rece^vec^-  Formally,  it  is  desired  to  find 

the  sequence  x.  = x , ...,x  which  gives 

J m 

P (x=Xj j £=£j ) = maximum 


where  is  the  specific  received  sequence,  and  all  possible 
sequences  of  transmitted  characters,  x,  are  used  to  determine 


which  specific  sequence  yields  the  maximum  value.  The 
sequence  x^  which  yields  the  maximum  is  then  the  maximum 
likelihood  estimate  of  the  transmitted  sequence  if  it  is 
assumed  that  the  transmitted  characters  are  equiprobable; 
it  is  the  maximum  a posteriori  (or  minimum  error)  estimate 
if  the  actual  probability  of  transmission  of  each  character 
is  utilized  [10] . 

In  general,  it  would  be  necessary  to  compute  and  compare 
the  probability,  P (x=x^ \z=z_ j ) , for  all  possible  sequences  x^. 
However,  if  it  is  assumed  that  the  morse  code  is  a Markov 
source,  then  the  problem  of  finding  the  MAP  estimate  reduces 
to  a problem  of  maximizing  a sum  and  the  Viterbi  algorithm 
may  be  used. 

In  the  following  development,  a shorthand  probability 
notation  is  used  to  facilitate  writing  of  probability 
statements.  The  statement  p(x^lz^)  is  used  to  mean 
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P(Xj{=a^  j zk=aj)  where  the  a^,aj  are  the  characters  of  the 
code,  i.e.,  dot,  dash,  element-space,  letter-space.  No 
confusion  should  result,  since  in  all  cases  the  notation 
P(u)  is  intended  to  mean  the  probability  that  u is  equal 
to  some  specific  value. 


B.  SOURCE  MODEL 

A third-order  Markov  model  of  the  morse  code  exhibits 
a good  deal  more  probabilistic  structure  than  a first-order 
model,  as  can  be  seen  by  comparing  the  transition  probabilities 
shown  in  Table  VIII.  In  the  interest  of  simplicity,  however, 
it  was  decided  to  use  a first-order  model.  The  assumption  of 
a first  order  model  then  means  that 


1 

I 


s 

% 


F ( ^k  | xo , • • • , xk_  ^ ) — P ( xk  | xk__ 

where  is  the  kth  character  of  a transmitted  sequence. 

The  transition  matrix  lists  the  following  transition 
probabilities : 


P(xk|xk>_1)  for  each  xk  = ai 


where 

al  = * 

(dot) 

(Vl-la) 

a2  = — 

(dash) 

(Vl-lb) 

a *■  a 

(element-space) 

(VI-lc) 

a4  = - 

(letter-space) 

(Vl-ld) 
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(Word  spaces  were  not  considered  as  separate  characters, 
but  as  combinations  of  letter-spaces  and  e lenient- space s. ) 


C.  SEQUENCE  PROBABILITIES 

Based  on  the  first  order  model  assumption,  the  probability 
of  any  particular  transmitted  sequence  of  length  n is  given  by 


n-1 

P ( xo ,x^, . . . , x^_ j.)  — II  P (x^| xi-l^ 


(VI-2) 


Then,  given  an  input  sequence  to  the  decoder  (zq, . . . , zn_^) > 
use  of  Bayes1  rule  expresses  the  desired  conditional 
probability  as 


p(xo'-**'xn-ll2o'*,,'zn-l) 


p(V"  *zn-l  ixof  ~ * • 'xn-l5  ,P(xo'  • * * *xn-l* 

'n-15 


P(Z0'  • • • 'Zr._l  ) 


(VI-3) 


which  is  the  probability  to  be  maximized. 

Assuming  that  the  thresholded  output  is  memory less,  the 
conditional  output  sequence  probability  becomes: 


P(z 


o' 


zn-l  xo'"*xn-l> 


n-1 

n p(z.  jx. ) . 
i=0 


(VI-4) 


Although  the  thresholded  output  is  by  no  means  memory less, 
due  to  the  decision  directed  nature  of  the  Q estimation 
algorithm  in  the  preceding  filter,  this  assumption  is 
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nevertheless  made  in  order  to  render  the  computation  of  the 
necessary  probabilities  tractable.  The  dependence  of  the 
thresholded  character  output  decision  on  previous  and  future 
decisions  will  be  removed  to  a certain  extent  in  Section  D, 
justifying  the  assumption  of  memory lessness  at  this  point. 

Then,  using  (VI-2)  and  (VI-4) , and  realizing  that 
P(zQ, . . . /Zn_i ) is  constant,  maximization  of  (VI-3)  is 
equivalent  to  maximizing  the  expression: 


n-1 

n P(xi|x.  ,) 
i=0  1 1 ■L 


n-1 

n P(z. |x. ) 
i=0  1 1 


Maximization  of  this  sequence  is  equivalent  to  minimizing 
the  negative  logarithm,  since  In  P(-)  is  a monotonic  function 
of  P ( • ) . Thus 


L(xo' * 


' xn- 1 


) i 


n-1 

l (In  P(x. |x.  .)  + In  P(z. |x.)] 
i=0  ill  ii 


is  the  function  to  be  minimized  by  the  Viterbi  algorithm. 
An  outline  of  how  the  Viterbi  algorithm  performs  this 
minimization  is  presented  in  Appendix  B. 


D.  LIKELIHOOD  COMPUTATION 

The  likelihoods  P(z^jx^)  may  be  computed  from  the  smoothed 
signal  amplitude  and  received  character  duration  as  follows. 
Define  the  following  figures  o::  merit  for  amplitude  and 


duration : 


am  c amplitude  figure  of  merit  for  a dot-length  duration 
t = time  figure  of  merit  for  a dot- length  duration 
A^  = amplitude  figure  of  merit  for  a dash-length  duration 
= time  figure  of  merit  for  a dash-length  duration 
If  these  figures  of  merit  are  scaled  such  that  their 
values  are  between  0 and  1,  then  they  may  be  interpreted 
as  follows: 

am  = probability  that  a mark  occurred  during  a dot-length 
interval. 

t = probability  that  a mark  is  a dot,  or 

= probability  that  a space  is  an  element-space. 

A = probability  that  a mark  occurred  during  a dash-length 
m interval. 

Tm  = probability  that  a mark  is  a dash,  or 

= probability  that  a space  is  a letter-space. 
Likelihoods,  then,  may  be  computed  by  utilizing  these  values 
as  probabilities.  For  example,  the  probability  that  the 
thresholded  output  is  a dot,  given  that  the  input  is  an 
element-space  is  simply: 

P(z=a1|x=a3) 

= Pr (z=dot j z=mark) • Pr ( z/dash | z=mark)  *Pr(z=mark) 


The  likelihoods  for  each  case  were  determined  as  above 


and  are  given  as  follows: 


P (z=a, ] x=a. ) = a t (l  - T ) 
1 1 1 mm  m 


P (z=a_ | x=a. ) = a (1  - t (1  - T) ) 
2 1 i m m m 


p(z“a3lx“ai)  - <i-am>vi-v 


PU-a^x-^l  = (1-OH  * t_(l-TJ) 


m m 


for  i = 1,3  where  the  a^  are  given  by  (VI-1);  and 


P(z=a1|x=a.)  = aro(l  - T^l-tJ) 


P(z=a2|x=a.)  = ym(l-tB) 


P(z=a3|x=ai)  = d-am)(l  - TJl-tJ) 


P(z=a4ix=ai)  = d-yvi-y 


for  i = 2,4. 


The  figures  of  merit  a , A . t , T were  obtained  by 

m m m m J 

using  the  thresholded,  smoothed  output  to  make  "tentative" 
decisions,  and  then  computing  the  merit  of  these  decisions, 
The  tentative  decisions  were: 


1)  If  xQut  - 1 and  measured  duration  2T,  then  = dot 

2)  If  xQUt  = 1 and  measured  duration  > 2T,  then  x^  = dash 

3)  If  xQut  = 0 and  measured  duration  2T,  then  x^  = element- 

space 

4)  If  xQut  = 0 and  measured  duration  > 2T,  then  x^  = letter- 

space 

For  x^  = dot  or  element-space,  the  previous  T values  of 
smoothed  output  were  averaged  and  the  amplitude  figure  of 
merit  was  taken  as 

A 

0 -f>VT> 

A A 

am  = 3Ts(T)/S  + 0.5  a>;s(T)>-| 

A 

1 XS(T)  > | 

where 

xg (T)  - the  average  of  the  smoothed  output,  xg,  over  the 
previous  T seconds. 

A 

a = amplitude  of  smoothed  output  signal. 

The  time  figures  of  merit  were 

1 ° < fd  < T 

t = 2 - (t,  +T)/2T  T < t , < 3T 

m a — a -- 

0 3T  _<  td 


0 


m 


1 ~ (Vtd)/(0*67Td) 

1 


0 i td  1 Td/3 


V3  < td  < Td 


Tdi*d 


where  td  = measured  duration  of  character  duration. 


These  functions  are  sketched  in  Figure  22.  For  x^  = dash 

or  letter-space,  the  previous  Td  values  of  xg  were  averaged 

to  obtain  the  value  for  A : 

m 


0 


Am=  xs(Td)/S+0.5 
1 


f I 

*s  (T<i  i f 


These  likelihood  computations  allow  decisions  to  be  made 
by  the  Viterbi  algorithm  to  determine  the  most  likely 
character  on  a character-versus-character  basis.  It  was 
necessary,  however,  to  extend  these  computations  to  cover 
more  complicated  situations  such  as  that  depicted  in  Figure  23. 
The  thresholded  output  shown  decodes  as  . , although  the 

sequence  was  actually  transmitted.  The  Viterbi  algorithm 
implemented  using  the  above  likelihood  computations  decoded 
the  sequence  as  . , however,  since  no  provision  was  made 
to  account  for  the  non-momoryless  nature  of  the  thresholded 
output . 
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Two  modifications  were  made,  therefore,  in  order  to 
account  for  situations  such  as  this:  First,  when  a dash  or 

letter-space  was  decoded  by  the  thresholded  output,  this 
character  was  divided  into  three  equal  segments  and  dot  and 
element-space  likelihoods  were  computed  for  each  segment. 
Secondly,  when  the  thresholded  output  consecutively  decoded 
three  short  characters,  then  the  total  duration  of  all  three 
characters  was  obtained  and  dash  and  letter-space  likelihoods 
were  computed  for  the  total  interval. 

E.  IMPLEMENTATION  AND  RESULTS 

The  algorithm  was  coded  in  Fortran  and  run  as  a 
subroutine  of  the  original  Kalman  filter  and  smoothing 
programs.  Sequences  of  9-11  elements  in  duration  were 
decoded.  In  order  to  determine  the  contribution  of  context 
information  supplied  by  the  first  order  transition 
probabilities,  the  algorithm  was  also  run  with  equiprobable 
transition  probabilities,  i.e.  as  a ML  sequence  estimator. 

The  results  are  summarized  in  Tables  IX  and  X.  Again 
both  bit  and  letter  error  rates  are  presented  with  the  hand- 
decoded  smoothed  output  repeated  here  for  ease  of  comparison. 
Table  XI  shows  a comparison  of  bit  error  rates  for  ML  and 
MAP  estimation  showing  a slight  improvement  provided  by  the 
MAP  estimation,  taking  advartage  of  transition  probabiJ i ties . 

The  reduction  in  error  rate,  although  not  great  as 
hoped  for,  shows  that  the  thresholded  output  bit  error  rate 
can  be  improved  significantly  at  the  higher  SNR's,  but 
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TABLE  IX 


VITERBI  DECODER  ERROR  RATES  - 35  wpm 


AR  SEQUENCE,  PERFECT  CODE: 


SNR  (2  kHz)  SMOOTHED  OUTPUT  VITERBI  OUIPUT  IMPROVEMENT  RATIO 

IN  BIT  ERROR  RATE 


NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

(db) 

(%) 

(%) 

(%) 

(%) 

6 

0.83 

9 

.35 

3 

2.4 

5 

3.0 

27 

2.5 

23 

1.2 

4 

6.7 

49 

6.8 

49 

- 

3 

35 

96 

35 

100 

TYPICAL  SEQUENCE, 

PERFECT 

CODE: 

SNR  (2  kHz) 

SMOOTHED  OUTPUT 

VTTEFBI  OUTPUT 

IMPROVEMENT  RATIO 

NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

IN  BIT  ERROR  RATE 

(<*>) 

(%) 

(%) 

(%) 

(%) 

6 

0.70 

8.0 

0.33 

3 

2.1 

5 

1.2 

15 

0.90 

11 

1.3 

4 

4.5 

34 

4.4 

34 

- 

3 

30 

92 

30 

96 

— 
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TABLE  X 


VITERBI  DECODER  ERROR  RATES  - 25  wpm 


AR  SEQUENCE, 
SNR  (2kHz) 

PERFECT  CODE: 
SMOOTHED  OUTPUT 

VITERBI 

OUTPUT 

IMPROVEMENT  RATIO 

NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

IN  BIT  ERROR  RATE 

(cfc) 

(%) 

(%) 

(D 

(%) 

6 

.77  , 

10 

0.31 

2 

2.5 

5 

1.3 

17 

1.0 

13 

1.3 

4 

1.7 

18 

1.5 

17 

1.1 

3 

4.5 

36 

4.4 

38 

— 

TYPICAL  SEQUENCE,  PERFECT  CODE: 


SNR  (2kHz) 

SMOOTHED  OUTPUT 

VITERBI 

OUTPUT 

IMPROVEMENT  RATIO 

NO  PRE-FILTER 

BIT 

LTR 

BIT 

LTR 

IN  BIT  ERROR  RATE 

(db) 

(%) 

(%) 

(%) 

(%) 

6 

0.70 

8 

0.37 

3 

1.9 

5 

1.1 

12 

0.80 

10 

1.4 

4 

1.2 

15 

0.90 

13 

1.3 

3 

2.9 

24 

2.7 

22 

1.1 
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TABLE  XI 


COMPARISON  OF  ML  AND  MAP  ESTIMATES 


SNR  (2kHz) 

NO  PRE-FILTER 
(db) 


MAXIMUM  LIKELIHOOD  MAXIMUM  A-POSTERIOKI  IMPROVEMENT 
ESTIMATOR  ESTIMATOR  RATIO 


BIT  ERROR  RATE 

(%) 


BIT  ERROR  RATE 

(%) 


6 

5 

4 

3 


0.45 

0.91 

1.1 

2.8 


0.37 

0.80 

0.90 

2.7 


1.2 

1.1 

1.2 

1.0 


Typical  sequence  25  wpm,  perfect  code 
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bit  error  rates  of  about  3%  or  higher  remain  practically 
unaffected.  Again,  it  was  noted  that  most  errors  are 
isolated  dot  insertions  during  word-spaces.  Since  the  third 
order  model  accounts  for  the  small  transition  probability 
of  such  events,  auch  a model  should  virtually  eliminate  this 
type  of  error,  resulting  in  a very  significant  decrease  in 
error  rates. 

Table  XII  shows  a typical  decoded  sequence  as  output  by 
the  algorithm,  with  the  filtered  and  smoothed  outputs  shown 
for  comparison.  This  sequence  was  part  of  the  35  wpm  AR 
sequence  at  5 dB  SNR  in  2 kHz.  Since  it  was  noted  that  the 
algorithm  created  some  new  errors  as  well  as  correcting 
errors,  likelihood  computations  could  probably  be  improved 
by  employing  better  character- length  density  estimation 
procedures . 

Two  examples  of  likelihood  computations  and  the  evolution 
of  the  most  likely  sequence  as  the  algorithm  progresses  are 
shown  in  Tables  XHIa  and  b.  Table  XHIa  is  an  example  of 
decoding  with  highly  probable  likelihoods,  while  Table  XHIb 
shows  an  example  of  a correction  by  the  algorithm.  The  array 
of  numbers  headed  by  SURVIVOR  SEQUENCES  indicate  to  which 
previous  node  the  node  at  stage  k is  connected;  the  length 
of  each  survivor  sequence  is  shown  immediately  below  this 
array.  The  line  through  the  survivor  sequence  array  shows 
the  final  path  for  the  minimum- length  sequence.  The  next 
array  shows  the  computed  log-likelihoods  for  each  character, 
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followed  by  the  minimum  length  sequence  with  its  length. 

(The  number  200  was  sufficiently  large  to  be  used  for 
infinity.)  Finally/  the  mark  and  space  durations  as 
determined  by  the  thresholded  output  are  shown  for  comparison 
In  these  tables  (Xllla  and  b) , the  following  numbers 
correspond  to  the  decoded  morse  characters: 

1 - dot 

2 - element-space 

3/4  - letter-space 
5,6  - dash 

The  letter-space  and  dash  are  represnted  by  two  numbers  since 
such  decisions  may  result  either  from  comparisons  made  on  a 
straightforward  character  versus  character  basis  or  from 
comparisons  made  utilizing  the  modified  likelihood  computation 
previously  described.  In  each  case  the  sequence  a.a— a.~ 
was  transmitted;  Table  XII lb  shows  how  the  Viterbi  algorithm 
corrected  the  thresholded  sequence  (/.. A.A.A.~)  to  form  a 
dash  from  the  inner  .a.  sequence.  This  situation  is  similar 
to  that  shown  previously  in  Figure  23. 


TABLE  XIX 

COMPARISON  OF  VITERBI  OUTPUT  WITH 
SMOOTHED  AND  FILTERED  OUTPUTS 


FILTERED  SEeARARUCALARSrEAREURARAR 

SMOOTHED  ARE  MRARARARARAREAREARARAR 

VITERBI  AREARARMRARARAREAN  AR  AR  AR 

FILTERED  RRAREARARARARARIAG 

SMOOTHED  AR  AR  ARARARARARIAG 

VITERBI  ARAR  AR  AR  AR  AR  AR  AR 


Note  : 

1.  Sequence  of  AR  at  35  wpm,  5 db  SNR,  tranmitted. 


SUMMARY  OF  VITERBI  OUTPUT: 


New  errors  made  2 
Errors  uncorrected  2 
Corrections  4 
Net  improvement  2 
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TABLE  Xlllb.  VITERBI  DECODER  COMPUTATION 
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DEC3DED 

MARK  SPACE  LENGTH  SEQUENCE 

0 +2  9.107  212621A 


VII.  PRE-DETECTION  MODEL  AND  FILTER 


Since  it  is  assumed  that  the  receiver  has  been  tuned  to 
the  signal  carrier  frequency,  it  is  sufficient  to  model  the 
signal  as  one  of  known  frequency  and  unknown  amplitude  and 
phase  of  the  form  A sin(o)t+0) . The  received  signal  then  is 
of  the  form 

z(t)  « A sin(wt+0)  + v(t) 

where  v(t)  represents  additive  white  gaussian  noise.  A state 
model  of  the  signal  process  may  be  obtained  by  rewriting  the 
transmitted  signal  in  the  form  a sin  wt  + b cos  o>t  [4], 
Letting  represent  the  discretized  signal  in  this  form,  the 
following  state  model  results: 


x1(k+l) 

1 

U)T 

x^k) 

x2(k+l) 

-0)1 

1 

x2(k) 

where  x2't)  ® b cos  wt  - a sin  u>t 

k = time  index 
t = sampling  interval 
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The  observation  model  then  is 


z(k)  = t 1 0 ] 


x-^k) 

x2(k) 


+ vik)  . 


This  model  may  be  written  more  compactly  in  vector 
notation : 


x(k+l)  = *(k)  x(k) 
z(k)  = H (k)  x(k)  + v(k) 

where  $>  is  the  state  transition  matrix  and  H is  the  measurement 
vector.  The  on-off  keying  nature  of  the  signal  may  be 
accounted  for  in  an  intuitive  way  simply  by  multiplying  the 
observed  value,  z(k) , by  the  probability  that  the  signal  is 
present.  This  probability  is  readily  obtained  from  the 
demodulated  output  of  the  filter  by  using  the  algorithm 
previously  derived  for  mark  and  space  transition  probabilities 
for  the  baseband  signal. 

B.  FILTER  ALGORITHM 

The  general  filter  algorithm  presented  in  Appendix  A, 
using  the  above  signal  model,  was  used  to  filter  the  (down- 
converted)  IF  signal.  Demodulation  was  accomplished  digitally 
by  squaring  and  averaging  the  x^  state  estimate.  The 
subroutine  used  previously  for  the  calculation  of  Q was  then 
used  in  exactly  the  same  way  as  for  the  baseband  model  except 
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that  the  indices  k and  j were  advanced  by  an  amount  of 
time  equal  to  the  delay  due  to  averaging  in  the  demodulation 
process.  Additionally  it  was  found  that  using  zero  proba- 
bility during  space  intervals  was  too  low  to  allow  recovery 
when  the  signal  pulse  occurred.  The  probability  0.5  was 
found  to  be  sufficient  and  was  used  whenever  zero  probability 
would  normally  have  been  called  for. 

C.  IMPLEMENTATION  AND  RESULTS 

This  filter  was  programmed  and  tested  using  test  signals 
of  -2  dB  though  +2  dB  SNR  in  a 2 kHz  bandwidth,  and  -15  dB 
through  -11  dB  in  a 2 kHz  bandwidth  with  100  Hz  bandpass 
filtering  prior  to  sampling.  In  order  to  determine  the 
effectiveness  of  modifying  z(k)  by  the  probability  as  des- 
cribed above,  the  filter  was  also  run  with  the  probability 
set  to  1.  The  signal  was  sampled  at  4000  samples  per  second, 
the  (down- converted)  carrier  frequency  was  1000  Hz,  and  the 
modulating  signal  was  a square  wave  with  period  equivalent 
to  a code  speed  of  25  wpm.  Because  of  the  lengthy  processing 
time  (1  second  of  data  required  about  30  seconds  of  processing 
time) , no  large  sample  error  rates  as  such  were  obtained. 
However,  as  can  be  seen  from  the  output,  Figures  24  through 
31,  the  filter  performed  well  on  signals  of  SNR  -1  dB  and 
above  (2  kHz)  and  -14  dB  and  above  with  100  Hz  pre-filtering. 

Figures  24  through  27  are  typical  examples  of  the  test 
run  made  using  the  straightforward  filter  with  no  modification 


of  the  observed  signal.  In  these  figures  channel  1 is  the 

input  signal,  channel  2 is  the  filtered  signal,  and  channel 

$ 

3 is  the  demodulated  output.  Figures  24  and  25  are  the 
results  obtained  from  the  signal  in  the  2 kHz  bandwidth; 
Figures  26  and  27  show  the  results  of  100  Hz  analog  bandpass 
filtering  prior  to  sampling. 

Figures  28  through  31  are  the  outputs  of  the  processor 
using  the  modified  observation  model.  Channel  1 is  the 
input  signal;  channel  2 is  the  input  multiplied  by  the 
probability  obtained  from  the  transition  probability  estima- 
tion algorithm;  channel  3 is  the  filtered  signal,  and  channel 

4 is  the  demodulated  output.  The  input  signals  were  the 
same  as  those  shown  in  Figures  24-27. 

Table  XIV  presents  the  results  of  a bit  error  rate 
analysis  made  on  a sample  size  of  approximately  100  bits. 

Since  the  test  signal  was  not  morse  code,  no  letter  error 
rates  ve re  obtained.  The  projected  letter  error  rates 
shown  in  the  table  were  determined  simply  by  multiplying 
the  bit  error  rate  by  10  since  this  is  approximately  the 
proportionality  factor  between  these  two  error  rates,  as 
can  be  seen  from  Tables  III-VI. 

Based  on  this  limited  data,  the  conclusion  may  be  tenta- 
tively drawn  that  a processing  scheme  employing  100  Hz 
analog  filtering  followed  by  discrete  optimum  linear  filtering 
and  detection  will  yield  acceptable  decoded  error  rates  on 
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Unmodified  Pre-Detection  Filter  Output,  -1  dB  SNR 


Channel 
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FIGURE  27.  Unmodified  Pre-Detection  Filter  Output,  -14  dB  SNR,  100  Hz 
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29.  Modified  Pre-Detection  Filter  Output,  -1  dB  SNR, 


Channel 


Modified  Pre-Detection  Filter  Output,  -14  dB  SNR,  100  Hz  BPF 
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TABLE  XIV 

ERROR  RATES  FOR  PRE-DETECTION  FTT.TRRTNC 


(a)  No  100  Hz  BP  Fi j ter; 


SNR 

(2  kHz) 
(dB) 


Bit  Error  Rate 
(%) 


Projected  Letter 
Error  Rate 
(%) 


2 

1 

0 

-1 

-2 


0 


0 


0 


0 


0 

1 


c 

1C 


20 


(b)  With  100  Hz  BP  Filter; 


SNR 

(2  kHz) 
(dB) 


Bit  Error  Rate 
(%) 


Projected  Letter 
Error  Rate 
(%) 


-11 

-12 

-13 

-14 

-15 


0 

0 

0 

1 

1 


0 

0 

0 

10 

10 


NOTE:  Rates  are  based  on  small  sample 

size  of  approximately  100 
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signals  of  SNR  as  low  as  -14  dB  in  a 2 kHz  bandwidth. 
Smoothing  of  the  state  estimates  at  this  processing  stage 
would  probably  yield  additional  jain  although  an  additional 
penalty  in  processing  time  would  be  incurred. 

Although  this  scheme  meets  the  design  objectives 
specified  for  the  processor,  it  is  probably  unrealistic  to 
assume  that  such  processing  could  be  implemented  in  real 
time  on  any  existing  machine  without  parallel  processing. 
Coding  efficiency  could  undoubtedly  be  improved  but  the 
inherent  number  of  multiplications  involved  in  the  filter 
algorithm  would  eventually  limit  the  processing  speed. 

One  possible  alternative  is  to  down-convert  the  received 
signal  to  the  0-100  Hz  band,  and  with  a 100  Hz  low-pass 
filter  in  place,  sample  at  200  samples/sec.  With  such 
filtering,  the  processing  described  above  would  be  feasible. 
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VIII.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS 

The  results  of  the  various  processing  schemes  considered 
in  this  investigation  lead  to  the  following  definite 
conclusions. 

1.  Kalman  filtering  of  the  demodulated  morse  signal 
provides  at  least  a 50%  reduction  in  letter  error  rate  over 
unprocessed  letter  error  rates  of  approximately  60%  or  less. 

2.  Smoothing  of  the  demodulated  signal  provides  a 
reduction  in  letter  error  rate  of  approximately  30%  over 
filtering  alone,  resulting  in  an  overall  reduction  of  65% 
over  the  unprocessed  error  rate. 

3.  Viterbi  decoding  of  the  morse  characters,  using  the 
smoothed  state  estimate  for  likelihood  computation  and  using 
a first  order  Markov  model  of  the  code  to  obtain  transition 
probabilities,  provides  a further  significant  reduction  in 
error  rate  if  the  input  error  rate  is  on  the  order  of  10% 

or  less.  For  input  error  rates  larger  than  10%,  Viterbi 
decoding  is  of  little  value. 

4.  In  almost  all  cases,  the  processor  performed  better 
on  sloppy  code  and  typical  sequences  than  on  perfect  code 
and  AR  sequences.  This  behavior  is  to  be  expected  since  the 
statistics  of  the  input  signal  should  match  those  for  which 
the  processor  was  designed  in  order  to  echieve  optimum 
performance. 
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5.  By  using  a 100  Hz  bandpass  filter,  pre-detection 
Kalman  filtering  allows  recovery  of  the  code  with  a resulting 
error  rate  of  about  10%  or  less  for  signals  whose  SNR  in  a 

2 kHz  bandwidth  is  -14  dB  or  higher. 

6.  The  Pickering  230-D  decoder  (see  Appendix  C)  allows 
recovery  of  the  code  with  a resulting  error  rate  of  about 
10%  or  less  for  signals  whose  SNR  in  a 2 kHz  bandwidth  is 
approximately  -6  dB  or  higher,  also  by  using  a 100  Hz 
bandpass  filter. 

By  making  reasonable  extrapolations  to  various  other 
processing  arrangements  based  on  the  results  presented  here, 
the  projected  performance  of  several  alternative  processors 
may  be  obtained  with  a high  degree  of  confidence.  The 
processing  arrangements  presented  in  Table  XV  are  listed  more 
or  less  in  order  of  increasing  complexity  and  power,  showing 
the  letter  error  rates  to  be  expected  from  each;  the  projected 
figures  are  indicated  by  an  asterisk.  The  rates  presented 
assume  that  the  processors,  except  for  the  human  operators, 
are  preceded  by  a 100  Hz  bandpass  filter. 

Since  no  measurements  were  made  for  SNR's  above  -6  dB, 
except  for  the  Pickering  230-D,  the  projected  rates  in  the 
-4  dB  column  were  all  determined  by  extrapolation  of  the 
measured  values.  The  projected  values  for  coherent  demodula- 
tion (row  6)  are  based  on  the  presumption  that  such  demodula- 
tion would  provide  approximately  3 dB  of  processing  gain  over 
non-coherent  demodulation;  the  subsequent  values  for  Kalman 
filtering,  smoothing,  and  Viterbi  decoding  (rows  7-9)  were 


TABLE  XV 

PERFORMANCE  OF  ALTERNATIVE  PROCESSING  SCHEMES 


SNR 

(in  2 kHz) 

(dB) 

Processor 

-15 

-14 

-13 

-10 

-7 

-4 

1.  Ncn-ccherent 
demodulation 

>50 

>50 

>50 

>50 

35 

10* 

2.  (1)  followed  by 
Kalman  Filter 

>50 

>50 

>50 

>50 

15 

5* 

3.  (1)  followed  by 
smoothing 

>o0 

>50 

>50 

>50 

9 

3* 

4.  (3)  followed  by 
Viterbi  Decoder 

>50 

>50 

>50 

>50 

3 

1* 

5.  Pidcering  230-D 

>50 

>50 

>50 

~50 

15 

7 

6.  Coherent 
Demodulation 

>50* 

>50* 

>50* 

35* 

10* 

5* 

7.  (6)  followed  by 
Kalman  Filter 

>50* 

>50* 

>50* 

15* 

5* 

3* 

8.  (6)  followed  by 
smoothing 

>50* 

>50* 

>50* 

10* 

3* 

2* 

S.  (8)  followed  by 
Viterbi  Decoder 

>50* 

>50* 

>50* 

4* 

2* 

1* 

10. Pre-detection 
Kalman  Filter 

20* 

10 

5* 

0* 

0* 

0* 

1L  (10)  followed  by 
Viterbi  Decoder 

15* 

4* 

2* 

0* 

0* 

0* 

12.  Typical  Operator 

? 

? 

? 

? 

10* 

5* 

13. Good  Operator 

? 

? 

10 

5 

1 

0* 

Letter  error  rates  (%)  ^Projected 


obtained  by  applying  the  respective  improvement  ratios 
actually  obtained  for  non-coherent  demodulation.  In  the 
case  of  the  pre-detection  Kalman  filter  (row  10) , a 10%  error 
rate  was  actually  obtained  for  the  -15  dB  entry,  and  no  errors 
were  obtained  for  the  -13  dB  entry.  However,  since  the  small 
sample  size  tends  to  decrease  the  confidence  in  these  figures, 
these  rates  were  increased  on  a subjective  basis  by  observing 
the  quality  of  the  output  signal.  Again  the  subsequent  rates 
for  Viterbi  decoding  (row  11)  were  obtained  by  applying  the 
previously  determined  improvement  ratio.  The  figures  for 
the  human  operators  are  the  author's  estimate  based  on  the 
error  rates  obtained  previously  for  the  amateur  radio 
operators.  A degradation  factor  of  3-6  dB  should  probably 
be  added  to  the  SNR's  shown  for  typical  field-operation 
performance . 

In  summary  it  may  be  concluded  that  the  performance  of 
a good  operator  can  be  approached  by  a processing  scheme 
employing  pre-detection  100  Hz  bandpass  filtering  followed 
by  discrete  Kalman  filtering  and  a Viterbi  decoder.  The 
performance  of  a typical  operator  can  be  obtained  by  either 
the  230-D  or  by  coherent  demodulation  preceded  by  100  Hz 
bandpass  filtering,  with  further  improvement  provided  by 
Kalman  filtering,  smoothing  and  Viterbi  decoding. 

B.  RECOMMENDATIONS 

A more  appropriate  model  for  the  demodulated  baseband 
signal  would  be  one  which  incorporates  the  exponential 
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rise-times  and  fall-times  of  the  signal  pulses  instead  of 
the  abrupt  rise-times  and  fall-times  as  used  here.  A filter 
incorporating  such  a model  would  probably  have  the  effect 
of  reducing  the  errors  caused  by  extremely  short  dot 
insertions  during  letter-spaces  and  word-spaces.  Better 
estimators  for  received  demodulated  signal  noise  power  and 
for  character  duration  mean  values  and/or  probability 
densities  should  be  tested,  although  it  is  felt  that  little 
advantage  would  be  gained  from  more  sophisticated  techniques 
in  an  actual  operational  environment.  A third  (or  higher) 
order  Markov  model  of  the  code  would  undoubtedly  show  a 
significant  improvement  over  the  first-order  model  in  the 
effectiveness  of  the  Viterbi  decoder  at  sufficiently  low 
input  error  rates.  Such  Markov  modeling,  along  with  improved 
likelihood  calculations,  deserves  further  investigation. 

The  pre-detection  Kalman  filter  shows  the  greatest 
advantage,  and  more  investigation  of  such  filtering,  and 
possibly  smoothing,  with  the  goal  of  making  the  processor 
real-time,  should  be  undertaken.  Down -conversion  of  the  IF 
signal  to  100  Hz  or  so  followed  by  a 100  Hz  bandpass  filter, 
and  sampling  at  200-400  samples/sec,  may  be  the  solution. 
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APPENDIX  A 


THE  DISCRETE  KALMAN  FILTER 

The  discrete  Kalman  filter  is  an  extension  of  the  more 
familiar  Wiener,  minimum  mean-square-error,  matched  filter 
to  nonconstant  coefficient  multivariable  systems  with 
nonstationary  noise,  implemented  in  sequential,  or  recursive, 
form.  The  result  of  every  processing  cycle  is  the  current 
estimate  of  the  state  under  consideration.  As  each  new 
observation  is  made,  the  current  estimate  is  updated  to 
reflect  the  information  content  of  this  new  measurement. 

A brief  outline  of  the  derivation  of  the  filter  algorithm 
is  presented  below. 

The  message  model  is  described  by  the  linear  vector 
difference  equation: 

x(k+i)  = £(k)x(k)  + r(k)w(k) 

where  the  input  noise,  or  random  forcing  function,  w is  a 
zero-mean  white-noise  process,  with  covariance 

covtw(k) ,w  ( j) ] = Q(k) 6^  (k- j) 

The  observation,  or  measurement,  model  is  given  by  the  linear 
algebraic  equation 
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£(k)  = H(k)x(k)  + v(k) 

where  v(k)  is  also  a zero-mean  white-noise  process , with 
cov[v(k) ,v( j) ] = R(k)6k(k-j)  . 

For  simplicity,  it  is  assumed  that  w and  v are  uncorrelated, 
and  that  w and  the  initial  value  of  x are  uncorrelated. 

The  first  step  in  obtaining  the  estimate  at  time  k is 
to  predict  ahead  from  the  estimate  obtained  at  time  k-1. 

This  prediction  may  be  expressed  as  the  conditional 
expectation: 

x(k|k-l)  = E[x(k)  !z(k-l)  ] . 

But  since  the  measurement  iz(k-l)  is  embedded  in  the  previous 
estimate,  x(k-l|k-l),  this  prediction  may  be  expressed  as 

x(k]k-l)  = $x(k-ljk-l)  +j[EU(k-l)]  . 

Since  E[w(k)]  = 0,  this  reduces  to 


x(kjk-l)  = ^x(k-l|k-l)  . 

The  estimate  at  time  k may  then  be  determined  by 
considering  it  to  be  a summation  of  this  prediction  plus 
a correction  term  employing  the  measured  value: 
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x(k|k)  = ^x(k-l|k-l)  + G(k)  (z(k)  -£(k|k-l)  ] 

where  £(k|k-l)  is  determined  as  follows: 

£(k|k-l)  = E[z(k)  |z(k-l)  ] 

= E [ (Hx(k)  + v(k) ) |z(k-l)] 

= E[Hx(k) |z(k-l)]  + E[v(k) |z(k-l)]  . 

Under  the  given  assumptions,  this  reduces  to: 

£(k | k-1)  = H E[x(k)  |z(k-l)  ] 

= H ± x(k-l|k-l)  . 


The  filter  equation  (A-l)  then  becomes: 


x(k|k)  = (k-1 1 k-1)  + G(k)  [z(k)  -H$x(k-l|k-l)  ] 

where  G(k)  for  optimum  filtering  is  yet  to  be  determined. 

It  is  desired  to  determine  G(k)  such  that  the  resulting 
estimates  are  optimum  in  a minimum  mean-square-error  sense. 
Since  the  error  in  the  estimate  is  given  by: 

x(k)  - x(k|k)  , 
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the  covariance  matrix  of  estimation  error  is 

V(k|k)  = E[(x(k)  -x(k|k;)  (x(k)  -x(kjk))T]  . 

Minimizing  a scalar  quadratic  form  based  on  this  matrix 
will  yield  the  optimum  gain  G(k) . Derivations  are  available 
in  several  texts  [4],  [11],  and  will  not  be  presented  here. 
The  optimum  gain  results  in  the  following  algorithm  for  the 
discrete  Kalman  filter. 

Gain: 

G(k)  = V(kjk-l)  HT  [H  V (k  j k-1)  HT  + R] _1 
Estimation: 


x(k|k)  = x(k jk-1)  + G(k)  [z(k)  -Hx(k|k-1)] 


Estimation  variance: 


V(kjk)  = [I  - G(k)H]  V(kjk-l) 


Prediction  variance : 


V(k+l|k)  = l V(kjk)$T  + Q(k) 


Prediction: 


x(k+i|k)  = 4>  x(k|k) 
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APPENDIX  B 

THE  VITERBI  ALGORITHM 


An  instructive  and  informative  description  of  the 
Viterbi  algorithm  is  presented  in  [8];  the  following  outline 
is  based  on  this  article.  The  MAP  sequence  estimation 
problem  previously  stated  in  Section  VI. A.  is  formally  the 
same  as  the  problem  of  finding  the  shortest  path  through  a 
certain  graph,  called  a trellis  diagram.  In  this  diagram, 
illustrated  in  Figure  31,  each  node  corresponds  to  a distinct 
state  of  the  Markov  signal  process  and  each  branch  represents 
a transition  to  some  new  state  at  the  next  instant  of  time. 

In  this  representation,  every  possible  state  sequence 
corresponds  to  a unique  path  through  the  trellis. 

Each  branch  is  assigned  the  length 

= -m  ‘ ln  p(ziJ V 


where 

represents  a transition  from  to  x^ 


x^)  are  the  sequence  transition  probabilities 
while  are  the  likelihoods  of  a particular  state. 


The  p <**+1 
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The  algorithm  for  determining  the  shortest  path  through 
the  trellis  diagram  is  a version  of  forward  dynamic 
programming  and  is  stated  as  follows: 

N — number  of  states*  K = i - 

i length  of  input  sequence 

(time  index) 

(survivor  terminating  in  x.  ) 

K 

(survivor  length) 

2.  INITIALIZATION: 
k = 0 

-(V~xo  ' arbitrary,  m ^ x 

o 

£(xo^=0»  £(m)  = °°,  m / x 

o 

3.  RECURSION: 
a • Compute : 

£(Vl'V  for  all  ck  , 

t>.  Find: 

— ^xk+l^  min  I(xk+i'xk> ' for  each  xk+1; 


1.  STORAGE: 
k 

x(x^)  , 1 £ X^  < M 
£(x^)  , 1 <_  X^  _<  M 
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St°re  r>(Xj?+1)  and  the  corresponding  survivor  sequence 

<3.  Set  k to  k+1  and  repeat  until  k = K. 

As  an  example  [8],  the  recursive  determination  of  the 
shortest  path  through  the  trellis  shown  in  Figure  32  is 
shown  in  Figure  33. 
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APPENDIX  C 


PICKERING  230-D  PERFORMANCE  EVALUATION 


The  Pickering  230-D  is  a currently  available  automatic 
decoder  and  transcriber  which  includes  some  front-end 
processing.  The  front-end  consists  of  what  is  essentially 
a type  of  coherent  detection  scheme  with  a bandwidth  of 
about  180  Hz;  the  center  frequency  of  the  unit  tested  was 
at  875  Hz.  The  letter  error  rate  versus  SNR  of  the  230-D 
was  determined  in  the  laboratory  using  the  model  KB-1 
keyboard  to  send  perfect  code.  The  error  rates  were 
determined  for  . -»th  a 2 kHz  bandwidth  and  a 100  Hz  bandwidth 
and  are  shown  in  Table  XVI.  A performance  evaluation  of  the 
230-D  for  error  rates  obtained  using  actual  operator- 
transmitted  code  with  no  noise  is  available  in  Ref.  [2], 
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TABLE  XVI 


Pickering 

230-D  Error  Rates 

SNR 

35  wpm 

30 

wpm 

25  wpm 

(in  2 kHz) 

2 kHz  100  Hz 

2 kHz 

100  Hz 

2 kHz  100 

(dB) 

(%) 

<%) 

(%) 

(%) 

(%) 

(%) 

1.6 

1 

3 

1 

0 

0 

0 

0.4 

4 

15 

4 

6 

0 

0 

-0.9 

29 

6 

22 

13 

21 

6 

-2.0 

- 

7 

- 

11 

- 

6 

-4.4 

- 

7 

- 

7 

- 

4 

-6.4 

- 

15 

- 

15 

- 

5 

-8.9 

- 

21 

- 

27 

• - 

22 

-10.5 

- 

60 

- 

78 

- 

61 

-12.4 

_ 

mm 

1 


J 

# 

l 

f 

i 

3 

i 


Notes : 

1)  Sample  size:  Approximately  100  letters  in  each  case 

2)  Perfect  Code 
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COMPUTER  PROGRAMS 


« U U U 

cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc 
c 

C THIS  PROGRAM  IMPLEMENTS  THE  POST  -DETECT  I ON  KALMAN 

C FILTER  AND  LINEAR  SMOOTHER/  ALONG  WITH  THE  REQUIRED 

C SIGNAL  PARAMETER  ESTIMATOR  ALGORITHMS.  THE  following 

c utility  subroutines  are  used: 

C BUFFERIN  - READS  DATA  ON  INPUT  TAPE. 

C DAL  - D/A  CONVERSION  AND  OUTPUT  ROUTINE 

C THE  FOLLOWING  SUBROUTINES  ARE  PROVIDED: 

C BACK  - BACKWARD  FILTER  ROUTINE 

C STATS-  ESTIMATES  SIGNAL  PARAMETERS 

C VARW  • COMPUTES  THE  VARIANCE  OF  W(K) 

c 

c INPUT  PARAMETERS  AT  TIME  OF  EXECUTION  ARE  I 
C INITIAL  ESTIMATE  OP  T 

C THE  PARAMETERS  T1  AND  T2 


17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 
3? 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 


C THE  DOT-DURATION  DENSITY  PARAMETER#  LOOT 

C THE  DASH-DURATION  DENSITY  PARAMETER/  DDASH 

C 

cccccrccccccccccccccccccccccccccccccccccccccccccccccccccccc 

c 

REAL  LD9T/MEANX/MEAN#MEANXB/M\X1/MNX?#mfrit 
DIMENSION  XHSMN1 (50)#XHSM(15D)/XHSMN2( 1C0)/XHSMD( 100) 
DIMENSION  EVARF2(P50) /XHATF2(E50)#EVARF(250) 

DIMENSION  X3B(125)/PVAR?'2(  125) /XHAT3?(  125) 

DIMENSION  IBUF ( 500 ) # XHATr ( 250 ) 

DIMENSION  XHAT91(25C)/PVARE1(?50)#X3(250)/XHT ( 1C ) 
DIMENSION  MERIT* 4/2, 12)/ TRANS < 11) 
CartM0N/9L0CKl/XNT/XNTC/XHSM/XHSM3/ I J# I Ul/ I J2/ I JL/ I J</ 
1TS/TDS/FMEANS/NSH0RT 
C9MMSN/3L0CK2/NELEM, MERIT 
C9M-0N/BLPCK3/TRANS 
C 

NAMELIST  LD0T/DDASH,T/T1/T2 

C ENTER  TRANSITION  PROBABILITIES  FOR  VITERBI  DECODER 
C 

TRAN'S  ( 1 ) » - ALOG  ( 0 .682 ) 

TRANS(2)*-AL0G(0.31S) 

TRANS(3)«-AL0G(0.504) 

TRANSU)  «-AL0G(0.396) 

TRANS (5) *-AL0G(0#25) 

TRAN$(6) «-ALOG(0.?5) 

TRAVS<7)»-AL03(0.25) 

TRA\S(8)«-AL0G(0.?5) 

TRAN$(9)«-AL0G(C»684) 

TRANS(10)»-AL0G«0.316) 

TRANSdl)'-ALOG(O.l) 

39  CONTINUE 
C 

c input  parameters 
c 
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52 

53 

54 

55 

56 

57 

58 

59 
6C 
61 
6? 

63 

64 

65 

66 
67 
6? 
69 
79 

71 

72 

73 

74 

75 

76 

77 

78 

79 
89 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 
IOC 
1C1 
102 
10? 
1C4 


OUTPUT ( 101 ) • ENTER  T/  Tl/  AND  T2  (*SEC)' 

9UTPUT { 101 ) 'ENTER  LOST  AND  DDASH  (MSEC)' 

INPUT (101  ) 

C 

C INITIALIZE  variables  and  indices 

c 

T-T/2.  l LD9T *L?9T/2 • l DDASH«DDASR/2. 

Tl«Tl/2.  i T?  = T2/2 • 

A»LD9T/T 
B*DDASH/( 3.*T  ) 

X9UTL *0 ♦ ; Hf ANXn  * 0*5  l NEANX*Q.5  l XT»T  1 I T = T 

XTD=3.#T 

IX»9 

KS1*KS2=0 
VAl *VA23  1 • 

S1«S2=.5 

SS 1 * SS?  3 • 4 

^NX1=nnv?=0.5 

ni  = lN2=I£l  = IS2  = 0 

JT»JT?= JTD=JTD2=10 

jTC8«JTr=10 

NELE'^NSMORTbO 

I J* I Jl a T Jp- 1 1 * I 11  = 112  = 0 

SVM=S"N2  = 0. 

XMS”1  =XH‘JN2  = C» 

XHSMM(1)«0«  ; xh$m\2 ( 1 ) *0* 

IXN«C 

PVAR  = rVAR»VAr?ys0.5 

KIND  = C ; < I ‘.‘DP  * 9 ; JI\'D  = 0 ; JlNDF*0 

Gs 1 • ; xhat°*0.  ; I XML *0 

FM I N« • 05  ; XTl*xT2ri 
XTDl =XTD?=3**T 
XTC1*XTC?*T 

XTA=XTC=T 

D?  2 <1=1/4 
D9  2 K?=l/2 
Cp  ? <3*1/12 
2 XERlT(<l/K2/<3)=0f 

38  CONTINUE 
C 

C INPUT  DATA  FROM  TAPE 
C 

11?  CALL  EUFFERIN( 1/ 1/ IPUP/500/ IERR) 

1 IP  <IFRR.EC»1>  39  TO  1 

GO  T5  (1/111/310/112)/  1 ERR 
111  DO  99°  1\CCM/? 

I\'DE1=  ( J\D’t>n«?50-f  1 
INDE2*INDE*?50 
C 

C BEGIN  PP9CESSING 
C 

DO  °99  I NDE  X» I \0E1 / I NDE? 

X 1 • F L ■ ’ A T ( I ESL'P  ( INDEX)  >/2**23 


105: 

JO'.: 

10': 

!05: 

109: 

lio: 

ill: 

112: 

113: 

114: 

115: 

116: 

li-': 

hr: 

119: 
120: 
121: 
122: 
123: 
124: 
125: 
126: 
127: 
128: 
129: 
130: 
131 : 
13?: 
133: 
134: 
135: 
136: 
137: 
138: 
139: 
140: 
141: 
142; 
143: 
144: 
145: 
146: 
147: 
148: 
149: 
150: 
151 : 
152: 
153: 
154; 
155: 
156; 
157; 


C 

C UNPROCESSED  OUTPUT#  X9UT1 
C 

xouti«o. 

IF(Xl.GE.MEANX)  XBUT1«1* 

c 

C IX  IS  THE  RUNNING  TIME  INDEX 

c 

IX»IX+1 

IPI ly.GT.250)  ix«l 
C 

c i xn  inhibits  smoothing  algorithm  until  sufficient 

C DAT'.  IS  OBTAINED  (500  SAMPLES) 

C 

IXNslXN+1 

. IFUXN.GT.500)  1 XN  = 501 
C 

C STORE  INPUT  SAMPLES  IN  REVERSE  ORDER  FOR  BACKWARD 

C filtering 

C 

IF( IX.GT.125)  XB1=XBB( IX-125)  ; 68  T0  9 
X91«XB( IX) 

XBB( 126-IX)»XB(251-IX) 

9 X3 ( 251 • I X ) »X1 

CALL  STATS 
VARXF'VARX 

i 

C 

c FORWARD  FILTER  ALG9R1TW 

c 

399  GA!\F*PVAR/(PVaR+VARXF) 

EVAR* ( 1 • »GA INF ) *PVAR 
XHAT«XHATP^GAInF*(X1-MEANX-pXHATP) 

c 

c TMRESHOLDED  FILTERED  OUTPUT#  XPUT2 

c 

X')UT2*C-  « 

IF (XHAT»GE*0. ) XQUT2« 1 . 

'I  XHAT  • - 1 

I F ( XHA  T . GE  » 0 • ) I XHAT  * 1 

KIN0»KINDF  i JIND-JINDF  ; IXHL«IXHLF 
T«XT  i TD-XTO  ; LD0T»A«XT  l DDASH»B«XTD 
XH-XHAT 

350  CALL  VARw 

QP«Q«(FMEAN*#2) 

pvar«evar+gf 

KINDF-KIND  i Jl\DF«JIND  ; IXHLF-IXHL 
XHATp«XP 
C 

C STORE  FORWARD-FILTERED  esmmates  and  variances  for 
c SMOOTHING 

c 

EVARF1«EVARF2(  IX  )i  EVaRF2UX)*EVARF(  IX) 

EVARF ( IX ) «EVAR 
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iii.iT  n 


158 

15? 

160 

161 

162 

163 

164 

165 

166 
167 
16? 

169 

170 

171 

172 

173 

174 

175 

176 

177 

178 

179 

180 
181 
162 

183 

184 

185 

186 

187 

188 
18? 

190 

191 

192 

193 

194 

195 

196 

197 

198 

199 

200 
2C1 
202 

203 

204 

205 

206 
207 
20? 
20? 
210 


XHATF1«VHATF2< IX) i XHATF2 ( IX)=XHATF( IX) 

XHATF ( !X)»XHAT 
351  CALL  BACK 
CALL  V ARW 
G9*X  FMEAN3#  + 2) 

KINC3-KIND  ; JI\D8«JIND  } JXHLB*IXHL 
C 

C REVERSE  STOKED  VALUES  FROM  3ACKUAPD  FILTER  FOR 
C SMOOTHING 
C 

Ic<  IX. GT. 125)  XHTB1  = XMATB?( IX-125)  i GO  T0  49? 
XHTBl-XHATBl (IX) 

XHATB?(1?6-IX)=XHATL:1  (251- IX) 

492  CONTINUE 
XHATBl(251-IX)=XMATBP 

IF(  IX.GT.125)  PVBlsRVAR32( IX-125)  ; G?  T0  493 
PVB1 aPVARBl (IX) 

PVA5b2( 126-IV ) sPVARFU  (251-IX) 

493  C9NTIMJC 

PVARB1 <?51-IX5*°VARB 
XHATfiP«XP 
PVAP0bLvaR3+OB 
C 

C SMOOTHING  ALGORITHM 
C 

a'K*EVARF1  /{  1 .+EVARF1/PV51 ) 

EVARS*  ( ( 1 »-.'K/PVBl  )**2)»EVARF1  + { wk**2 ) /PVE 1 
wRK»(XHTBl/!5V31  )*EVARS 
IF(  IX.E0.250)  ,.'5'<  = 0 • 

XHATS*  X^ATE 1/  ( 1 ♦+EVA(<n/PVal  ) +WBK 
IF  ( IXN.LE.50Q ) XhATS  = 0»  ; TS*XT  ; TOS-XTD 
C 

C AVERAGE.  AND  ST0RB  SM00TMCD  ESTIMATE  AT  EACH  P0JNT  FOR 
C USE  LATER  IN  LIKELH9B0  COMPUTATIONS 
C 

I IT=C.75#TS 
111*111+1 

IFUI1.3T.150)  111*1 
11*11+1 

Ir ( 1 1 » GT • 50 ) 11*1 
IFUI.GT.IIT)  H = 1 
XHbl eXWSVNl (II) 

XM3*'\1  ( I I ) «X^ATS 

XHSV1*XHSM1+(XMATS-XHS1 > / ( 0.75*1 S) 

X H s M { I I 1 ) *XHSM1 

1 1 r^*C  ,A7*TDS 
112*112+1 

I F { IJ2 . GT • 1 00 ) 112*1 
IFUI2.GT.IIT2)  112*1 
113*113+1 

IF(  M3.GT.1C0)  113*1 
XHS2  = XHSMN2( I 12) 

XHSVN?( IJ2)*XHATS 
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211 

212 

213 

214 

215 

216 

217 

218 

219 

220 
221 
222 

223 

224 

225 

226 

227 

228 

229 

230 

231 

232 

233 

234 

235 

236 

237 

238 

239 

240 

241 

242 
24  3 

244 

245 

246 

247 

248 

249 

250 

251 
25? 

253 

254 

255 

256 

257 
255 
259 
?6C 
261 
26? 
263 


XMSM2«XHSM2+(XHATS-yHS2>/(0.67*TDS) 

XHSKO  < 1 1 3 ) *XH5M2 
IJMI1-10 

IF(IJ.LE.O)  IJ«150*IJ 
I J 1 * 1 1 1-5-1  IT 
IF(lJiat«0)  I Jl »150+ I Jl 
IJ2-II3-5 

IF { I J2  «LE • 0 ) I J2«10C+! J2 

xsum*o. 

DO  920  I *-2i  10 
XSUM*XSL'M  + XHT ( I ) 

920  XMT< 1-1 )=XHT{ I) 

XSU^sXSU^+XHATS 

XHT(10)»XHATS 

XSUM*XSUMV10. 

xout*o. 

1FIXSUM.GT.0.C000001)  X3uT«1* 

c 

C ESTIMATE  t and  td 

c 

C XNT  IS  THE  MARX  DURATION  COUNT 
C XNTC  IS  THE  SPACE  DJRATION  COUNT 
C 

KND  = C 

IF(  <xeuT-X8'JTL)  .LE.-0«99)  KND  = 1 J GO  TO  900 
IF ( X3UT »GE»  0.99)  NT*NT+ 1 ; GO  TO  990 
NT«0 

GO  TO  990 
900  XNT  *NT 
NT  *0 

I F ( (XNT«LT»0.5*T1).?R.(XnT*GT.6.»T2)  ) GO  TO  990 
IF(XNT.LE.(3.*T1  ♦ T2)/2.)  GO  TO  991 
JTD»JTD+1 

IF( JTD.EC.10) JTD2=0  ; XTD?»XTDl 
IF ( JTP.EQ.20)  JTD« 1 
XTD1«XTD1+(XNT-XTD1 J/JTD 
T02» JT02+1 

i JTD2.EG.10)  JTD1 *0  / XTD1«XTD2 
IF( JTD2.E0.20)  JTD2-1 
XTD2«XTD2+(XNT-XTD2)/JTD2 

xtd«xtdi 

IF ( JTD2»GT * JTC1 ) XTD=XTD2 

IFTXTO.UT. (2.*XT)  ) XTD«2.*XT;  XTD1 »XTD2  = XTD; 

1 JTD= JTD?s5 
GO  TO  990 
991  JT« JT+1 

IF(JT.EO.IO)  JT2»0  ; XT2*XT1 
IF ( JT»  E3»  20 ) JT«1 
XT1«XT1+(XNT*XT1 )/JT 
JT2« JT  2+1 

IFIJT2.E3.10)  JT«0  ; XT1»XT2 
IF { JT2.E3.20)  JT2« 1 
XT2«XT2+(XNT-XT2)/JT2 


1 

I 


< 

i 

1 
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264: 
265: 
266: 
267; 
268: 
269: 
270: 
271: 
272; 
273: 
274: 
275: 
276: 
277 : 
278; 
279: 
280: 
281: 
282; 
283: 
2841 
285: 
286: 
287: 
288: 
289: 
290 : 
291: 
292: 
293: 
294: 
295: 
296: 
297: 
298: 
299: 
300: 
301: 
302: 
303; 
304: 
305: 
306: 
307: 
308: 
309: 
310: 
311: 
312: 
313: 
314? 
315: 
316: 


XTA.XT1 

IF( JT2.0T.JT)  XT  A*XT2 
990  CONTINUE 

IE  ( { XOUT- X9UTL  ) • GE  • 0 • 99 ) <ND*l  ; Qg  rcj  iQOO 
iriyeu'.U.O.Ol)  MTC-NTCaI  I 38  T I 0 
NTC*0  ; 30  Te  1090 
1000  XNTC»NTC 
\TC«0 

!rU?TrC,,rT;^5;,n^e,;,WTC-KT-6-*T2>>  33  T3  1090 
GO  T8  mo  ’ ’ JTC=JT|:*1)  33  1051 

1091  IF ( JTC • EQ • 1 0 ) JTC2*0  ; XTC2»XTCl 
IE( JTC.EQ.2C)  JTC=1 

XTC1*XTC1  + (X\-TC-XTC1  >/JTc 
JTC2= JTC2+1 

IF  ( JTC2«E0#  10)  JTOC  ; XTC1SXTC? 

IF ( JTC2*  EG . 20 1 JTC2=1 

XTC2=XTC2+(XNTC^XTC2)/JTC2 

XTC=XTC1 

IF(JTC2»GT.JTC)  XTC=XTC2 
SC  vSE  SWITCH  1 IS  USED  TO  SFLFCT  VITFRrt 

option  during  program  execution  ~ 8 DEC9DcR 

I^JSENSE  SWITCH  n 1 092#  1093 
10-2  r NTC.GT.4MTS)  KND  = 1 i XNTC  = NTC  ; NTC*0 
I;  < KND . En • 1 ) CALL  LIKELIHOOD 
1C93  CONTINUE 

XT=(xTa+XTC)/2. 

X9UTL=X9UT 

o.  tput  variables  to  d/a  routine  for  analog  recording 


TN0RM-XT/1OO. 

lC^3A^r‘?iwMf1'X"UT2')<HAT'><H191'><H,TS'x93T'VA:)>f' 

999  CONTINUE 
GO  TO  38 

310  r«mi’  ,f:n3  9f  run  ’ H1T  * TS  GO  ' 

GO  TO  39 


SUBROUTINE  BACK 

THIS  ROUTINE  IS  THE  BACKWARD  FILTER 

*;*I,1AL,ZE  indices  for  backward  filter  based  on 
MNAL  values  9F  rfMrfAKD-FILTEREO  EStI-aTEs 

I E ( I X * NE • 1 ) 30  TO  490 
IF(KINDF.EQ.C)  KINDB«0  I 30  TO  360 
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317: 

318J 

319: 

320: 

360 

321: 

322: 

323: 

324 : 

361 

325: 

326: 

327: 

328: 

329: 

490 

330: 

c 

331: 

L 

332: 

c 

333: 

334 : 

3355 

336: 

337: 

333: 

339: 

491 

340: 

341 : 

342J 

450 

3435 

c 

344*. 

c 

345: 

c 

346: 

347: 

c 

34  «; 

r 

w 

349: 

c 

350: 

c 

351: 

c 

352: 

c 

353: 

c 

354: 

355: 

356: 

357: 

358: 

359: 

360 : 

361 : 

362: 

363: 

364: 

365: 

366! 

367: 

c 

368: 

c 

369  5 

c 

KINf)B«XT-KI\DF 

IFUJNDB.LT.O)  kindb«xtd-<indf 

if(kindt-lt-o)  <!Nor«o 

1 F ( J I NQF • CO • 0 ) JINDB»0  l G8  TO  361 
JIMDtfsXT-JlMDF 

1 F ( J J NQB • LT • C ) JIND5«XTD-JINDF 
IF ( J I NDB.LT • 0 ) JINDP«0 
C8NTJN0E 

XHAT9P=XHAT  j 1 XHL9 * I XHAJ 

PVARB'EVAR  ; VARXQ=VARX  i MEANXB»M£ANX  ; GBsGr 
TS»TB  ; TDS«TDB  i FVEANS^FMEAMB 
FMEANB*FMEAN  ; TB’XT  : TDB'XTD 
CONTINUE 

FILTER  ALGORITHM 

GAINB*PVAR9/(FVAR3+VARX3) 

EVARB*(1.-GAI\B)*PVARB 

XHATB'XMATBP  + GAINE*  (XB1-MEANX5-XHAT5P) 

IXHATBs-1 

IF(XHAT9.GE.O.  ) I XHAT3*  1 
I XMAT= I XHATS 

KINpaKINOB  i JIND=JINDB  i IXHL'IXHLB 

IXHLL'IXHLLB  ; T=T3  t TD=TDB  ; LD9T=A«T  ) DDASH«B»TD3 

XM«\HAT5 

RETURN 


SUBROUTINE  STATS 

THIS  SUBROUTINE  CALCULATES  THE  INPUT  SIGNAL  MEAN, 
VARIANCE#  AND  ESTIMATES  THE  SIGNAL  AMPLITUDE  AND  SNR 


INPUT  MEAN  AND  VARIANCE  CALCULATIONS 
IM1.JM1+1 

IF ( I Ml • ED* 500)  I M2  * 0 ; VA2-VA1  l MNX2-MNX1 
IF( IM1.EG.1C00)  I M 1 » 1 
MNX1*MNX1+(X1-MNX1 )/IMl 
VAl=VAl  + ( (Xl-MF.ANX)  **2-VAl  )/JMl 
IM2«r‘2*l 

I F ( Ik2.FQ.500)  I Ml e 0 l V A 1 ■ V A 2 ; MNX1  = MNX2 
IFUk2.F3.100C)  JM2*  1 
MNX?«KNX2+(  X1-'"NX2)  / IM2 
VA2«VA2+( (Xl-M£ANX) #*?-VA?)/IM2 
KEA\X«MNX1 
V A ■ V A 1 

IF<Ik?.GT.IM1)  MEANX«MNX2  ) VA«VA2 
SIGNAL  AMPLITUDE  ESTIKAT9R 
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i 


370 

371 

372 

373 

374 

375 

376 

377 

378 

379 

380 


383 

384 

385 

386 

387 

388 

389 

390 

391 

392 

393 

394 

395 

396 

397 
393 

399 

400 

401 

402 

403 

404 

405 
4C6 

407 

408 

409 

410 

411 

412 

413 

414 

415 

416 

417 

418 

419 

420 

421 

422 


JF(XI.IE.MEANX)  68  T0  80 
IS1-IS1+1 

IFUS1.EQ.530)  IS2-C  i S2-S1 
IFUS1.EG.100C)  IS1«1 
S1«S1+(X1-S1)/IS1 
IS2»1S2*1 

IF C IS2.EC.50C)  IS1«C  J S1-S2 
IF ( I S2.E3. 1000)  I S2* 1 
S2-S2+ ( XI -S2 ) / I S2 
S»S1 

IFUS2.GT.1S1  > S«S2 
38  T 0 81 

80  CONTINUE 
KS1-KSK1 

IFKS1.EQ.500)  KS2-0  ; SS2«SS1 
IF(KSl.EQ.lCOO)  KS1 = 1 
SS1=SS1+(X1-SS1)/KS1 
KS2-KS2+1 

lF(KS2..Eri.50C)  <Sl*0  1 SS1-SS2 
IF { K$2«EQ» 1000 ) KS2-1 
.SS2»SS2+(X1-SS2)/KS2 
SS-SSl 

IF(kS2.GT.KS1 ) SS-SS2 

81  C9NTIMUE 
FMEAN-S-SS 

IF ( FMEAN#LT  »FM  J \ ) FME AN  = FMJ  N 
C 

c i se  variance  estimator 
c 

VARX*VA-0»9»(FmEAN*«2)/4« 

IF(VARX.LE»0. ) varx*o.ooooooi 
RETURN 

c 

c 

c 

c 

subroutine  varw 

c 

c q estimation  algorithm 

c KIND'TJME  INDEX/  K/  FOR  MAR<  PROBABILITIES 

C JINO'TIME  INDEX/  J/  FOR  SD ACE  PR83AB 1 L I T I ES 

C 

C (F9R  USE  WITH  PRE-D  FILTER/  INITIALIZE  Kl\'D/JI\D  TO  50) 
C 

XP-XHJ  P»1«0 
IF(IXHL»E3«0)  GP  TO  10 

IF( ( ( IXMAT-IXML) «GT.O) »ANDt( JIND.GT.T*UD8T> ) JI\D*0; 
IK  I ND»0)  GO  TO  10 

IF { ( IXHAT-IVWD .GT.O>  IXHAT'-IXHAT  i XP--XH 
IF ( ( ( IXHAT-IXHL) .LT.O) •AND.(KIND.GT.T-LO0T) ) J I ND ■ 0 ) 
KIND-O;  30  TO  10 

IF ( ( IXHAT-IXHL) .LT.O)  I XHAT ■ » IXHAT  ) XP--XH 
10  IF  (IXHAT-EO-1)  <IND*KIND*1 


l3‘ 


<*23 

IF(IXHAT.EG«-1)  J! NO" J I MD+ 1 l GO  T9  20 

<*2<* 

C 

<*25 

C 

MARK  PROBABILITIES 

<*26 

C 

<*27 

XK  *K  I N D 

<*28 

JF(XK*LE* (T-LD8T))  G0  TO  11 

<*29 

G9  TO  12 

<*30 

u. 

c«o. 

<*31 

IF(KIN'D.EG.l)  XPeFMfAN/2. 

<*32 

GO  TO  100 

<*33 

12 

IF  ( (XK.LE*  (T  + LOOTM  .AND.  (XK.GT*  (T-LDQT)  ) ) G9  TO 

13 

<♦34 

GO  TO  14 

<*35 

13 

P/JK01*  { T«XK)/(4.*LD9T  J+0.75 

<*36 

PW<M«1.  - P/.KCl 

<*37 

Q«P >.'<01  * r» v-.* K N 1 ; P«Pw<0lJ  G9  T9  100 

43?. 

14 

IF ( (xK.LF . (TD-DDASH)) .AND* ( XK • GE » ( T +L09T ) ) ) Q = 0* 

• 

/ 

<*39 

1 GO  TO  100 

<***0 

IF ( (XK.LE. (TO +00 ASH) ) .AND* ( XK  * GE  * (TO-DDASH) ) ) 39 

T9 

17 

<*<*1 

GO  T?  18 

<*<*2 

17 

PWKG1"  (Tf)-XK)/(2.*DDASH)  + 0.5 

<*<♦3 

PWKM*1.  -Pn'KOI 

<*<*<* 

g»Pwkci*o,ak\'1;  p=p.vkci;  go  to  ico 

445 

18 

G«0*25;  GO  TO  ICO 

446 

C 

447 

C 

SPACE  PROBABILITIES 

<*4? 

c 

44  9 

20 

XJ*JIN0  ; P=C • 5 

450 

IF(Xj.lp* (T-L09T)  ) GO  TO  21 

451 

GO  TO  ?2 

452 

21 

Q = C« 

453 

I F ( JIMD.EQ* 1 ) XP=-F”fAN/2* 

454 

GO  T9  100 

455 

22 

IF (( XJ.LE* (T+LDOT) ) . AND* (XJ.QE.I T-LDOT)))  GO  TO 

23 

<*56 

GO  TO  24 

457 

23 

PW<00«(-XJ/(2.«LD9T)+0.5**(  l.  + T/LOOT  ))*l?*/17.+5./17* 

45  £ 

Prf/KNO® 1 • »PWK0C 

459 

C.»PWKC0*PWKN0;  p«PWK00+0.5JI  G9  T9  IOC 

460 

24 

I F ( (XJ.LE  * (TO-DOASM) ) .AND* (XJ*GE* (T+LD2T )))  G = 0* 

; 

461 

1 GO  TO  100 

46? 

IF  C (XJ.LE* (TD  + DO ASH) ) *AVD* (XJ.GE* (TD-DDASH) ) ) 39 

T9 

27 

463 

GO  T9  28 

464 

27 

P W K 0 0 = ( ( -XJ/(?.*DDASH)+0*5*'  ( 1 * +TD/OOASH  ) ) )**0.8  + C 

*2 

465 

PWKN0=1 .-PwKCC 

466 

G«P.%KC0*PWKN0;  P*P^KO0  + O»5)  GO  T9  100 

467 

28 

IF ( xj.lP .5*  «T ) 0*0.  ; G°  TO  100 

468 

PWK0C*25. «T**2/XJ*#2 

469 

PWKN0«1  .-PaKOC;  r.  = P/>KOO**PWKNO;  P«PWK0O+C*5 

470 

ICC 

CONTINUE 

471 

IP(XK*GT.10**T)  K I N D = 0 ; G-C.25 

472 

!F(yj.GT.10**T)  JINJ=0  i 0S0»?5 

473 

|F(P.GT*1*)  P"1*0 

474 

1XHL« IXHAT 

475 

RETURN 

} 
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END 


0r 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

1^ 

15 

16 

17 

18 

19 

20 
21 
2? 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 


C 

c 

c 

c 


LIKELIHOOD 


this  subroutine  calculates  the  likelihoods  OF  each 
CHARACTER  / USING  THE  METH(jD  GIVEN  IN  THE  TEXT  OF 
THE  THESIS 


COMPILATION 

SUBROUTINE 
C 

c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 
c 


MERITU,1,N) 
MERIT (2# 1#N) 
HER ! T ( 3j 1«N ) 


MERI  T (3*2#N) 


MERIT (4*1*N) 
HER  IT ( 4* 2#  N ) 


IS  THE  DOT  LIKELIHOOD 
IS  THE  ELEMENT-SPACE  LIKELIHOOD 
IS  THE  LETTER-SPACE  LIKELIHOOD  FOR 
COMPUTATIONS  HADE  ON  A CHARACTER  VS 
CHARACTER  BASIS 

IS  THE  LETTER-SPACE  LIKELIHOOD  FOR 
COMPUTATIONS  INVOLVING  THREE  SHORT 
CHARACTERS 

IS  THE  CHAR  VS  CHAR  DASH  LIKELIHOOD 
IS  THE  THREE  SHORT  CHAR  DASH  LIKELIHOOD 


real  merit 

DIMENSION  HERI T(4i2> 1?) »XHERT(3> 

CIHFNSION  'XHSMI  15C)<XHSmD<  1 00  ) aESTORE  ( 8 ) 

DIMENSION  MARK! 11 )ifSPACE( 11 ) 

C9Mwon/5l9C<1/XNT#X\TC#XHSM,XHSMDj! J* I Jl/ I J2, IJL* I J<# 

1 T$* TDS, PAEANS iNSHORT 
COM^ON/BLDCKP/SELEM, merit 
C0M'/(>N’/BloCK4/mARK#  f SPACE*  NCHAR 
NCHAR*,NCHAR+1 
MARK (NCHAR ) *2»  »XNT 
NSPACE(NCHAR) *2t#XNTC 

M A<E  TENTATIVE  decisions  based  on  THRESHOlDED 
Sm0OThED  OUTPUT 

IFIXNT.LT. 0.5)  GO  TO  103 


103 


IF(x\T.GE.2.*TS) 

1G0  TO  1C2 

IF  UXKT.LT.  2.  *TS).  AND*  (XNT.GT.  0.5  ) ) 

1G0  TO  101 

JF  (X,\TC»GF*2.*TS)  EDUR'XNTC;  nshort«o; 


eduRsxnt;  nshort=o;  esum*o.; 

EDUR*XNT; 

esum*o»; 


40 

41 

42 

43 

44 

45 

46 

47 


lse  TO  102 

IF( (XNTC.LT. 2.0* TS) . AND . ( XNTC • GT. 0. 5 ) ) EDUR*XNTC 
C 

c computations  for  short  characters 
c 

101  NELFM-NELEM+3 

\SH^RT«NSH0RT+1 

IF ( NSH0RT  *QT. 8 ) NSH3RT*0 
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48 

49 

50 

51 

52 

53 

54 

55 

56 

57 
5.8 

59 

60 
61: 
6? 

63 

64 

65 

66 

67 

68 

69 

70 

71 
7? 

73 

74 

75 

76 

77 

78 
7° 
80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 
100 


EST9RF ( NSH9RT  ) «EDJR 
ESUV*ESUM*EDUR 

IF  (\5H0RT.GT.3)  ESJV»ESUM-EST0RE(NiSHeRT*3) 

T M 1 » 1 • 

IF(FOUR.GT.TS)  TM1«2.-(EDUR+TS>/(2.*75) 

TM2=0. 

IF  (F.DUR«GT  . TCS/3.  ) TN2«1 ( TOS-EDUR ) / { 0»67*TCS  ) 
XM£RITs(  XHSM(  I J)/FMFASIS*0#5)*TM1*( 

IF ( XVER I T • LT • 0 • ) XMLKIT.O. 

I F ( XMF.R  I 7 • GT  • 1 • ) XY£R  I 7 = 1 • 
tfER I T ( 1 , 1,  N'ELFm)  =XMERIT 

XME.R I T«  < 1 .«  (X^SV(  I J ) /FYEaN'S+O  • 5 ) ) #TM1  * ( 1 * -T^2 ) 

IF(  Xf'FRIT  .LT.C.  ) XV£R  17  = 0# 

!F(X^ERIT.GT.l . 5 XM£R I 7= 1 » 

MER IT  l^NELEZMlsX^rRlT 

X^t^  1 7“  ( XMSM  ( 1 j)  /F’“!F.A\S+C»  5)*C1»-TM1*(1»-TM2)  ) 

I f ( X^'ER I T »lT • 0»  ) X^FRIT  = 0. 

IF(YMERIT.GT.l . ) XVER I T= 1 • 

VER I T ( 4, 1 .» NE|_EM)  =XYrR  I T 

XME'?IT«(l..(YHS^nj)/r'irA\S  + 0«5)  ,*(  l.-T'11«(  1.-TM2J  ) 

IF ( y^FR I T .UT.O. ) xvf  R j 7 = C* 

IF(YVFRIT.GT.1«)  XMER ! T = 1 • 

MERIT( 3j 1 > NELEM ) a*VF R I T 
C 

C M5DIFIED  LIKEUMpfiO  COMPUTATIONS  F3R  3 OR  M0RE 
C SHORT  CHARACTERS  I\  SUCCESSION 
C 

IF  ( \SHrjf?T  *UT.  3 ) GO  TO  300 
IF(\£LEm«LT«3)  50  TO  300 

00  2CC  J. 1,3 

200  XMERTf  I)«AMAX(N!EKIT(l,l,KrLFM-3+l), 

1 MERIT (2, 1,NElFv-3+I ) ) 

XYhT»(  1...XYERT  ( 1 ) )*(  1.-XVERT(?)  )*  { 1 .-x^ERTC3)  ) 

X*IRTsXnRT**0. 33333 

TM2»1. 

IF(FSUW.LT*TCS)  7^2s1.-(T0S-ESUM)/(C.67*TDS) 

IF  ( T*'2  • t.T  • 0 • ) Tv2*0. 

XMER  I tb  ( xH5Mr)  ( IJ2)/Fr'EAf.S*0»5)*T^2»XMRT 
IF ( X^ER I T • UT « 0 • ) XMFRIT«0. 

IF ( V'ERIT • G T , 1 . ) XYER I T* 1 • 

MER  ! T { 4, 2,  NELE‘1-2)  =X'«FR  T T 

XmEPI7c(1.«(xms,',0<  I Jc ) /FMF  ANS  + O • 5 ) )*Tm2«XMRT 
Ir{XyFRlT»uT»C»)  XMF  R I T = 0 • 

Ir  ( XMERIT  • G T • 1 • ) XMf.Ri7«l. 

0ER  I 7 { 3,  2,  \ ElEm-2  ) = >'MrR  I T 
09  T()  300 
C 

C COMPUTATIONS  FpR  U0N3  CHARACTERS 

c 

1C?  \ELFN*NFLF*I*3 

1 J<= I J-EOUR/3. 

IF  ( I JK.LE.O)  I JX  = 15C<-I  J‘< 

IJU«IJ-(2.«E9UR)/3. 
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117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

149 

150 

151 

152 

153 


Ip<  I JL»L,E»0)  IJL*150+IJU 
TM1*0# 

!£!;DyR#LT,3,#TS)  Tmi.2..(EDUR*TS)/(2.#TS> 

irUMl.UT.O.  j TMl.O.  ; IF ( TMi  * GT • 1 * ) TM J * 1 • 

T“C*  1 « 

lVcl^n*,L1  #TDS)  ™2-l.-(TDS-ECUR)/(0.A7.TDSl 
X^!ERIT.(XHS^D(  IJ2)/FM£ASS+0.5)«TM2*(1..TM1) 
IF(XMERIT»LT.O. ) XMER I T * 0 • 

IP ( XMER I T »GT. 1 . ) XMER I T* 1 • 

mERIT(4#2/NElEm-2)«XMERIT 

X^ERIT«(  1 .«  (XHSM0(  I J21/FMEANS+0.5)  )«TM2#  ( 1 **TMi ) 
IF(XVERIT.LT.O. ) XMFRIT«0. 

IF ( XMER  I T • 5T . 1 • ) XMERIT-1. 
f^.ERlK  3,2/  NELFM-2)  * XMER IT 

li<elih00osMPUTATI9N,S  F8R  D9T  and  elepent*space ■ 

IF(EDUR/3» •LT#2»5*TS)  30  T0  3C0 

IF(XV,ERIT»LT.O. ) XMERIT=0. 

IF(XMERIT.GT.l.)  XMERITM# 

^ERI7{ 1, I/NFlEm-2) »XMERIT 

??fSi™UTixSsTfIJL>/F*,EANS*°-5,,*l»— tkim 

IF(XmERIT.LT.C. ) XMERIT*0. 

IF  ( X‘'ERIT  • G T • 1 • > XMERH«1. 

-ERIT (2/ l/NELEM-2) »X^ERIT 

rr  f'vJr* ! JJHS_1  ( *' JK  } /Fr£  A,\S+0 .5  > Ml.  -TM2*  < 1 . -TM1  ) ) 

IF ( XMERI  T «lT*0. ) XMER I T *0 • 

IF  (XMER IT »GT*1 . ) XMER  IT* 1 • 

IT C 1>  l#NELE*-!-l 

XHERIt.<i.MxhsM(Ij<,;f«eanS+0.5>  ) * < 1 • -TM2*  < 1 • -TM1 1 ) 
ifixverit.lt.o.)  XMER I T a o • M 

IF { XVCR IT .CT . 1 • ) XMER I T*  1 * 
kER  IT  ( 2/ 1/ NELEM-1 ) «XMER I T 

XMERITMXHS'K  I J)/Fyf  A\S+0»5)M  1»»T*^?*(  1»«>TM1 1 ) 

I F < XMERIT.LT.O. ) XMERIT«0* 

IF(X:-ERIT.GT.l.)  Xmcrit-1, 

^ERIT  ( 1/  1,N!ELEM)  «xyFRIT 

^PIrT'(1,-(XHSMnj)/FMrAS.s+o.5,  1m1.-Tm2m1.-TM1)> 

Ir (XMLR IT.LT. 0. ) XMERIT«0. 

IF { XMERIT »GT • 1 • ) XMtRIT»l. 

MERIT(2,  1,N'ELEM)  »XMERIT 

3 X\'T  C*X\T«0» 

IF  ( NELEM.GE  »9 ) GO  TO  301 
RETURN 

TA<E  THE  L0GARITMS  F0R  USE  3Y  THE  DECODER 
THE  NUMBER  200  IS  USED  FOR  INFINITY 

L DO  501  11*1/4 
DO  501  I2»1/\ELEM 
DO  501  13*1/2 


1 


154: 
155; ; 
156: 
157: 
158: 
159: 
160: 
161: 
16?; 
163: 
164; 
165: 
166: 
167? 
168: 
169: 
170: 
I7i: 
17?: 


11,1 3<  151 ’LE’°’ 1 

5C1  c”tIki5e'I3',J,‘‘ALCQIMER1TI!1',3'I?,> 

CALL  decider 

c 

C INITIALIZE  LIKELlHflODS  P0R  NEXT  ITERATION 


600 

505 


NCHAR-0 

DO  600  I ■ I# 1 1 

*AR<( I )»\S?ACE(  I )»0 

continuf 

DO  505  11=1,4 

D3  505  12=1,1? 

09  505  13=1,? 

W5R IT ( 1 1, 13, 12) »o» 

\5LEM=C 

RETURN 

END 


5 
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mm mm** 


— — ~ — -- — < 


■>  • vW’M«£4iSi9Atfii 


i 


end  of  compilation 

1:  SUBROUTINE  DECODER 

2:  c 

3:  c THIS  SUBROUTINE  IMPLEMENTS  THE 

4?  c VITERBI  ALGORITHM 

5:  c 
6:  c 

7:  REAL  LSAV/mERIT/LAM0A/LEN3TH/NU 

8:  REAL  LN'GTHl*LNGTH2#LNGTH3iLN3TH4,LNGTH5,LNGTH6 

9:  INTEGER  SEGSAV,CHAR 

10:  DIMENSION  LSAV<6/12)/ 1SAVE(6/12)/W3AVE(5> 

ll:  DIMENSION  TRANSt 1 1 ) / XTRANS ( 1 1 ) 

12 : D I MENS  I ON  LENGTH ( 6 ) / YLNGTH { 6 ) / WLNGTH { 6 > » ZLNGTH ( 6 ) 

13:  DIMENSION  MERIT(4/2.1?)/CWAR(6/12) 

14:  DIMENSION  MAPK(11),NSPACE< 11) 

15:  DIMENSION  NSrG(12)*NS0(12)/SEGSAV(5/12> 

16:  C9MM2N/BL0CK2/NELEM,MERIT 

17:  CaMMON/BLOCO/TRANS 

18:  COMMON/BLGCK^/MARK#  NSPACE/ nchar 

19:  DATA  L/0/ 

20:  c 

21:  C INITIALIZATION 

22 : c 

23:  DO  »0  1=1/12 

24:  80  NSEG! I ) -N$Q  C I ) * 0 

25 : c 

26:  C USE  A PRIORI  PROBABILITIES  OF  EACH  CHARACTER 
27;  c FOR  INITIALIZATION 
28!  C 
29: 

30: 

31: 

32: 

33: 

Oh  • 

35:  ICO 

36: 

R7  • 

38:  101 

39: 

40: 

41 : 

42: 

43:  10 

44;  c 

45:  C SFNSE  SWITCH  2 IS  USED  TO  SELECT  OUTPUT  OPTION 
46:  C 

47  5 lFISENSF.  SWITCH  2)  8/9 


LENGTH(1)«-AL03(0.269) 

LENGTH(2)--AlOG(0#341) 

LENGTH! 3 )«LENGTlM  4 )«-ALOQ( 0.159) 
LENGTH! 5) "LENGTH <6 )««ALOG( 0.232) 

DO  100  1-1/6 

WLNGTH!  I ) - ZLNGTH!  I ) -YLNGT'H!  I ) -200* 

CONTINUE 

DO  101  I-l/ll 

XTRANS! I ) -0. 

CONTINUE 
DO  10  1-1/6 
DO  10  J-l/12 
LSAV! I/J)»0. 

I SAVE ( I / J ) "0 
CONTINUE 
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i -i  nr  1 11!  it  r Tn ' I > lrrinw 1 


4 8 

49 

50 

51 

52 

53 

54 

55 

56 

57 
55 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 
100 


S WRITE (6*3000) 

3000  F0RMAT ( • 1 • ) 
wRIT£<6*4010) 

4010  FORMAT (5X* 'SURVIVOR  SEQUENCES’) 
WR I T£ ( 6*  400C ) (1*181,11) 

4000  FORMAT (14X*12(I2*5X)) 

9 CONTINUE 

C 

c main  algorithm 
c 

c NftDE  1 IS  A DOT 
c NODE  2 IS  AN  ELEMENT  SPACE 
C NODES  3 AND  4 ARE  LETTER-SPACES 

C NODES  5 AND  6 ARE  DASHES 

C 
C 

NELM1»NFLEM+1 
DO  900  <a 1* NELMl 
IF (K«EQ»2)  GO  TO  910 
GO  TO '911 

910  DO  Pll  J«l*ll 
XTRANSt J)»TRANS( J) 

911  CONTINUE 
IF(K.NE.NElv11)  GO  TO  920 
DO  920  J8l*ll 

XTRANSt J)«0. 

920  CONTINUE 
C 

C NODE  1 

LAMDA  = Lf:\GTH(2)  + xTRA\S(3)  l 1=2 
NU-LENGTH ( 3 ) +XTRANS ( 5 ) 

IF  ( NU»LT  •LAv'DA  ) LAMDAsNU  ; 183 
NU«ZLNGTH(4)+XTRANS(5) 
IF(NU*LT*LAMDA)  LAmDA=NU  I 1=4 
I SAVE  < 1*0  = 1 

LNGTH1.LAMDA*MERIT( 1 * 1 * K ) 

300  CONTINUE 
C 

C NODE  2 

lamda»lE\gth( d*xtrans( l ) ; i»i 
NU«ZLNGTH(4UXTRANS(6> 
IF(\u»lt.lam!)A)  lamoa«\u  ; 1*4 
NU ■ LENGTH ( 5 ) +XTRANS ( 9 ) 

IF  ( NU»LT»LAv,DA  ) LAMDA  = NU  l 1=5 
NU»ZLNGTH(6)+XTRANS(9) 
IF(\u»LT.LAMDA)  LAMDA«NU  l 1*6 
ISAVE ( 2*  < ) ■ I 

LNGTH28LAMDA*MERIT(2*1*K) 

301  CONTINUE 
C 

C NODE  3 

LAKDA»LENGTH< 1)*XTRA\‘S(?)  J 1*1 
NU»LENGTH(5)+XTRANS( 10) 
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101 

1C2 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

149 

150 

151 

152 

153 


ir<NU*LT.LAMDA>  LA^0A»NU  J 1*5 
N'J®ZLNGTH(6)*XTRANS<  10) 
IF(Nu*LT«IAMDA)  LAMOa-NU  I I *6 

NU*LENGTH(2)+XTRANS(  11 ) 
IF(NU*LT.LA"DA)  LA'IDAaN'J  l 1*2 
1 SAVE  (3*  0*1 

LNGTH3-LAMDA+ME9IT  ( 3/1*0 

302  CONTINUE 
C 

C NODE  4 

LANDA  *LENGTH( 1 ) +XTRANS ( 2)  l 1*1 
NU«ZLNGTH(4)  + XT9ANS<  7) 
JF(\U*LT.IAMDA)  LAMDAsNU  i 1*4 
NU 'LENGTH  (5  J+XTRANS  (10) 
lF(tJU*LT.LAM'jA)  lMoa'NU  i 1*5 
NU*ZLN'GTM(6  J + XTRANS  ( 10) 
IF<NU«LT.LAMOA)  LA'1DA«NU  > I ■ 6 
NU® LENGTH (2)+XTRANS(ll) 
IF(\u*LT.LAMDA  ) LAHDA'NU  l 1*2 
ISAVE(4/K)*I 

LNGTH4sLANDA+ME5IT(3#2/K) 

303  CONTINUE 

c 

C NODE  5 

LAN0A=LENGTH(2)+XTRA\S<4)  t 1*2 
NU* LENGTH  ( 3 ) +XTRANS  ( 8 ) 
IF(\U«LT#LAMDA)  LANDAsNU  i 1*3 
NU®  ZLNGTM ( 4 ) +X TRANS ( 8 ) 

IF  ( \‘U»LT •LA^f'A  ) LA'IOAeNU  ; 1*4 
I SAVE  (5/0*1 

LNGTH5*LANDA  + *ERIT(4/l/0 
3C4  CONTINUE 
C 

C NODE  6 

LA*0A*LrNGTH(?)+yTRA\S(4)  ; 1=2 

NU * LENGTH ( 3 ) +X TRANS ( 8 ) 

IF  ( \'U*LT. LA^DA  ) LAm.DA*NJ  J 1=3 
NU*ZLNGTH(4)*XTRANS(8) 

IF  ( \U»LT  «LAyDA  ) LAMDA«n:J  l 1*4 
I SAVE  (6/0*1 

LNGTh6*LANDA+MERIT(4,?/0 
3C5  CONTINUE 
C 

C STORE  LFNGTHS  FOR  SURVIVOR  SEQUENCES 
C 

LENGTH u ) =LNGTH1 
length ( ? ) *LNGTh2 
LENGTH(?)«LNGTW3 
LENGTH(4) *LNGTH4 
LEN3TH(D)«LNGTH5 
LENGTH ( 6 ) *LNGTH6 
DP  11  1-1/6 

11  LSAV<  1,0  -LENGTH  ( I ) 


145 


154 

155 

156 

157 

158 

159 

160 
161 
162 

163 

164 

165 

166 

167 

168 

169 

170 

171 

172 

173 

174 

175 

176 

177 

178 

179 

180 
181 
182 

183 

184 

185 

186 

187 

188 

189 

190 

191 

192 

193 

194 

195 

196 

197 

198 

199 

200 
201 
20? 

203 

204 

205 

206 


DO  200  1*1/6 
ZUNGTH( I )*YLNGTM( I ) 

YLNGTM(  I > *WLNGTW(  I > 

WLNGTH(I>«LENGTH(I) 

200  CONTINUE” 

9C0  CONTINUE 
C 

C DETERMINE  MINIMUM  length  SEQUENCE  FR8M  THE 
C SIX  SURVIVOR  SEQUENCES 
C 

NU*IENGTH<1>  ; ISURV«1 
09  901  1*2/6 

IE  ( LENGTH  { I ) »LT»NJ)  NU*LENGTHU)  l ISURV*I 
901  CONTINUE 

WEIGHT* LENGTH! ISURV) 

IM*1 

M*0 

N*ISAVE< ISURV/NELM1) 

NSEC!1)*N 
32  CONTINUE 

IF C (N.E0«4).eR.(N»EU.6) ) G0  T8  30 
1 

IF! <nElM1-M> .LE.O)  G8  T3  35 
NS*!SAVE(N/NELM1-M) 

G9  T0  31 
3C  M*H+3 

IF! (NELM1-M).LE»0)  GS  T9  35 
NS* I SAVE (N/NELHl*M) 

31  IM-Im+i 

NSEG! IM)*N«NS 
G9  T8  32 
35  CONTINUE 

09  40  I * 1 / I M 
40  NSG! I )*NSEO( IH-I+1 ) 

L-L+l 

WSAVE!L)=wEIGHT 
DO  71  1*1, JM 
71  SEQSAV(Li  n*NS2(I> 

IMl*JM-fl 
09  73  I * I N 1 / 1 2 
73  SEQSAV(L/I)»0 
C 

C OUTPUT 
C 

IF ( SENSE  SWITCH  2)  60/70 
C 

c OUTPUT  OPTION  1 - DETAILED  OUTPUT 
C 

60  CONTINUE 

00  12  J* 1 / 6 

12  WRITE! 6/ 4001 ) J/ ( I S A VE < J, < > / K* 1 / NElCM > 

4001  FORMAT (8X/12{ 11/ 6X)  ) 

WRITE (6/4002) 


207 

208 

209 

210 
211 
21? 

213 

214 

215 

216 

217 

218 

219 

220 
221 
22? 

223 

224 

225 

226 

227 

228 

229 

230 

231 

232 

233 

234 

235 

236 

237 
233 

239 

240 

241 
24? 

243 

244 

245 

246 

247 
24  8 

249 

250 

251 
25? 
253 


4002  FORMAT ( / ) 

wR I TE ( 6/5000 ) 

5000  F9RMATt5X/ 'SURVIVOR  LENGTHS') 

CO  13  J = 1 / 6 

13  WRITE (6,4003)  J, (LSAVC J, K ) , K« 1, NELEM > 

4003  FORMAT ( 8X/ I 1,?X, 12(F6.2, IX) ) 
wR I TE ( 6/ 4002) 
aRITE(6/1C03) 

1003  F9R"AT(5x, 'LIKELIHOODS' ) 

IJM 
Jl  «0 

DO  903  1*1/2 
JI'JI+I 

903  wR  I TL ( 6/  1 002 ) JI , ( MER I T ( I, I J, K ) , «« 1 , NELEM ) 

DO  905  1*3/4 

D9  ?C5  I J* 1 / 2 
JI*JI+1 

9C5  WR  * TE ( 6/ 1002 ) JI , ( MERIT ( I # I J, K ) , K-l/NFLEM) 

1002  FORMAT (8x,  Il,2X/  12 ( P6 . 2, 1 X ) ) 

WR  I TE ( 6/ 4002 ) 
wR I TE ( 6/ 4021 ) 

4021  F0RVAT(63X/ 'DECODED' ) 

WRITE (6/ 4020) 

4020  FORMAT  (?<*X/  'mARK',3X,  ' SDACE  ' / 12X/  ' LENGTH ',9X, 

1 'SEQUENCE ' ) 

904  wRlTE(6/1000)  MARK(l), NSPACECl), WEIGHT, (NSQ(K), 
!<*2/ JM) 

10C0  FORMAT (?CX,  I5/3X/  I5/11X/F9.3/1CX/  12H  ) 

DO  96C  I *?/ NCHAR 

wRITE(6/  1000)  MARK ( I ) / NSPACE ( I ) 

960  CONTINUE 

I r ( L • F 0 * 5 ) L«0 
GO  TO  72 

70  IF ( l »NE » 5 ) GO  TO  72 

C 

C OUTPUT  OPTION  2 - DECODED  SEQJENCES  AND  LENGTHS  ONLY 
C 

L»0 

WR  I TE  ( 6/6000 ) ( a'SAVE  ( I ) / I * 1/5  ) 

WRITE (6/ 6001)  ( (SEDSAVt I/J)/J«2/ 12), 1*1,5) 

6000  FORMAT (5x/5(r9.3,2X)//) 

6001  F?RMAT(5X/5(llIi/lX)  ) 
wR I TE  < 6/ 6003 ) 

6C03  F«RVAT(//) 

72.  CONTINUE 
RETURN 
END 
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1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 
4 8 

49 

50 

51 


C 

C 

C 


c 

c 

c 


21 


THIS  PftPGRAM 
DESCRIBED  IN 


IMPLEMENTS 

the  thesis 


THE  PRE 
TEXT 


•DETECTION  FILTER 


REAL  LD9T,M£aN'x, IDENT 
DIMENSION  I DENT ( 2, 2 ) , GA IM 2), H( 2) 

DIMENSION  TEMPM( 2,2), TEMPM1 (2,2), TEMPR ( 2 ) # TEMPC (2 ) 
DIMENSION  EVAR(2,2),PVAR(2,2),PHI t 2, 2 ) , PHI T ( 2, 2 ) 
DIMENSION  I 3uE ( 4000 ) 

NAMELIST  LOOT, DDASH,T,T1,T2, FREQ 
eUTPUT(lCl)  'ENTER  T AND  FREQ' 

OUTPUT ( 101 ) 'LOOT  AND  DDASH ' 

INPUT (101 ) 

INITIALIZE  VARIABLES  AND  INDICES 

XP1«XP2*0«5 
TAU«0*00025 
KT*0 

KIND*JIND*0 
XOUT  *C« 

MEANX-O* 

SS*C. 

VARX=0.5 

T-4 » *T  } LOOT 84«*LD8T;  DDASH«4 . *DDASh 
T1«4.*T1  ; T2*4«#T2 
FREQ-6. ?*319*FREU 
T0«3.*T 
IXHl-C 
P-l.C 

DO  20  1-1,2 
PHI ( I, I )*1. 

PH IT(I,I)«1» 

CONTINUE 

PHI(1,2)-PHIT(2,1 )*FREQ*TAU 
PHI  (2,1  UPHlTf  1,2)«-FREQ*TAJ 
DO  21  1-1,2 
D0  21  J-1,2 
IDEN'Tt  I,  J)«0. 

EVAR(I,j)-0. 

PVAP( I, J).Q. 

CONTINUE 
PVARU,1)«PVaR{?,2)«1. 

IDEnT ( 1, 1 ) ■ IDENT  C 2, ? ) «1 • 

H(l)-l. 

H(2)-C. 

100  CONTINUE 

INPUT  DATA  FR0M  TAPE 

112  CALL  9'jFFER  IN ( 1, 1,  I B'jF , 4 000/  IERR ) 

1 IF( IEPR-EQ-1)  GO  TO  1 


20 
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tmtmM 


52: 
53: 
54 : 
55: 
56: 
57: 
58: 
59: 
60: 
6i: 
62: 
63: 
64: 
65: 
66: 
67: 
68: 
69: 
70: 
7i : 
72: 
73: 
74: 
75: 
76  J, 
77J 
78: 
79: 
80: 
8i: 
82: 
83: 
84; 
85: 
86: 
87: 
88: 
89: 
90: 
91 : 
92: 
93: 
94; 
95: 
96: 
97: 
98: 
99; 
loo: 
101 : 
102: 
103: 
104; 


G 9 TO  (1/111,310,112)  l ERR 
111  09  999  I \'DLX«  1 ,4000 

C 

C BEGIN  PROCESSING 

C 

Xl«FLPAT(I3UF( INDEX)  )/2* *23 

X2»X1 

X1*P*X1 

IF(KT.!3T.  1000000)  KT*0 

<T*KT+1 

CAUL  STATS 

c 

C GAIN 

CALL  MvmULT(PVAR,H,  TEMPO 
CALI  VV^ULT (HiTENPC/TENP) 

TET/D1*1./(TEMP+VARX) 

CALL  MV^tJl.T  (PVAR/'-t/TEMPC) 

GAIN(1)=TENPC(1)*TENP1 

GAIN(2)=TE^PC(2)*TENP1 

C 

C ESTIMATION 

XP 1 * Xp 1 +G A 1 N ( 1 ) * (X1-XP1 ) 
XH2*XP2+GAIN(2)*(X1-XP1) 

C 

c estimation  variance 

call  VV.IJLT  ( 3 A I N,  H,  TB'KPM  ) 

09  TOO  1*1,2 
09  2 DC  J= 1 , 2 

200  TEMP-(  I,J)  = I0CNT(  I,  j)-Trr.PM(  I,  J) 

CALL  f,MULT(  TEVPM,PVAR,EVAR  ) 

C 

C PREDICTION  VARIANCE 

call  mvulT(Evar»phit,tempm) 

CALL  Mm'JLT  (PPI,TENPM,PVAR) 

C 

C ONE-STEP  PREDICTION 

Xp 1 = XP 1 +PM I (1,2) »XM2 
XP2  = PHI  (2,1  )*XHl  + X-(2 
C 

C SCUAPE  TILTERED  ESTIMATE  AND  L0U-PASS  FILTER 
C 

X*  XM1 * * 2 
XKT-KT 

IF ( KT  «GT « 50 ) GO  TO  60 
X9UT*X0UT+( 1 ./X<T)* (X-XOUT ) 

GO  T0  61 

60  XPUT«X'j!JT+0»02«  (X-XOUT) 

61  CONTINUE 

IXHAT  *-l 

IF(X3UT.GE»mEANX)  ixhat*i 
CALL  VAR .* 

C 

C OUTPUT  VALUES  TP  D/A  ROUTINE  FOR  ANALOG  RECORDING 
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105 

106 

107 

108 
109 
11C 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 


C 

XXHAT«FU0AT( IXHAT) 

CAUL  DAL(X2#X1/XH1»X8UT*GA1N( 1 ) /EVAR ( li 1 1 jEVAR ( 2/ 2 ) / 
1VARX/P#XXHAT) 

939  CONTINUE 
31C  G9  T6  100 
C 
C 
C 

SUBR9UTINE  STATS 
C 

C TUIS  SUBROUTINE  ESTIMATES  THE  N8ISE  VARAINCE 

C 

C 

XKT  «KT 

IF { KT»  GT * 4000 ) G9  T6  70 
MEANX«MEANX+( 1 ./XKT )« (X9UT-MEANX) 

GO  T9  71 

70  MEANX«MFANX+( 1./4C00. )* (X9UT-MEANX) 

71  CONTINUE 

IF(X9UT.GT.mEANX)  Ge  T9  80 
SS*SS+0.01* (XPUT-SS) 

80  CONTINUE 
VARX*SS 

IF(VARX.LE«0.01)  VARXeO.Ol 

RETURN 

END 
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^FORTRAN 

LS/G9 

1: 

SUBROUTINE  MYULTIA/B/C) 

p: 

C 

MULTIPLY  Twe  MATfilCES 

3: 

DIMENSION  A(P/2)/B(?/2)/CC2i2> 

«: 

D?  10  1=1/2 

5: 

CO  10  J-l/2 

6: 

1C 

CU/J)  = 0. 

7: 

DO  2C  1=1/2 

8: 

DO  20  J* 1 / 2 

9: 

D9  20  K = l/2 

10: 

C( I/J)*A!I/K)«8(K/J)+C(I/J) 

li: 

2C 

C9NT I \UE 

12: 

RETURN 

13: 

END 

end  er  compilation 

1:  SUBROUTINE  MvMULTU,3iC) 

2:  c multiply  matrix  by  column  vector 


3: 

DIMENSION  A(2,2),8(2)/C(2> 

4: 

D9  10  1*1*2 

5: 

10 

C< I )«0. 

6: 

DO  20  I *1 #2 

7: 

D9  20  K*  1 * 2 

s: 

C<  I )*A(  IiK)»9(K)+CH  ) 

9: 

20 

CONTINUE 

lo: 

RETURN 

ll: 

END 

END  8F  COMPILATION 

i:  subroutine  vmmult<a,6/C> 

2:  c multiply  Rev.  vector  by  matrix 
3J  DIMENSION  A(2),?(2,2)/C<2> 

<►5  D9  10  I ■ 1 # 2 

5:  io  cn>«c. 

6:  DO  20  1-1/2 

7:  DO  20  K* 1 / 2 

8j  CII)»A«HB(k,1)K(I) 

9:  20  CONTINUE 

io:  return 

11:  E 


— * cvi  rn  -r  u ) o oc  C', 


END  0F  COMPILATION 

SUBROUTINE  VVMULT ( A * B * C ) - 

C MULTIPLY  R9W  VECTOR  BY  COLUMN  VECTOR  1 

DIMENSION  A<2)#S(2)  f 

c*0.  I 

DC  10  I » l < 2 I 

C-A( I )*R( I )+C 

10  CONTINUE  ! 

RETURN  | 

END  J 

I 


END  8F  COMPILATION 

1J  SUBR9UT  INE  VMUlT(A,B,C> 

2;  C MULTIPLY  column  vector  by  row  vector 
3:  DIMENSION  A(2)j3(2)#C(2#2) 

: DO  10  1-1/2 

5:  DO  10  J-l/2 

6:  C(I#J)«AII)*B(J) 

7:  10  continue 

8;  RETURN 

9:  END 
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